Skip to content

Add dbt Fusion + DuckDB support#130

Merged
joellabes merged 9 commits intomainfrom
feature/fusion-duckdb
Mar 6, 2026
Merged

Add dbt Fusion + DuckDB support#130
joellabes merged 9 commits intomainfrom
feature/fusion-duckdb

Conversation

@joellabes
Copy link
Collaborator

Summary

  • Add Dockerfile.duckdb-dbtf and docker-compose-duckdb-dbtf.yaml mirroring the existing Snowflake Fusion pattern
  • Update trial_handler.py routing to select the new compose file for duckdb + dbt-fusion variants
  • Add dbt-fusion variant to all 44 DuckDB task.yaml files

Test Plan

  • All 46 existing tests pass
  • All 44 task YAML files parse cleanly with new variants
  • Run a benchmark against a DuckDB task using the dbt-fusion variant

🤖 Generated with Claude Code

joellabes and others added 9 commits March 5, 2026 15:53
Add Dockerfile.duckdb-dbtf and docker-compose-duckdb-dbtf.yaml mirroring
the existing Snowflake Fusion pattern. Update trial_handler routing to
select the new compose file for duckdb+fusion variants.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Each task with a db_type: duckdb variant now has a corresponding
dbt-fusion variant, enabling Fusion engine benchmarking on DuckDB.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Expand the CI matrix to include dbt-fusion project type alongside
the existing dbt runs, with appropriate Dockerfile selection.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Fixes Fusion compatibility issues across 9 projects:
- Moved test arguments (values, field, to, combination_of_columns) under 'arguments'
- Set require_generic_test_arguments_property flag in dbt_project.yml
- Removed deprecated target-path config
- Replaced fancy quotes with regular quotes (intercom)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- quickbooks004: test uses graph.nodes introspection unsupported by Fusion
- airbnb006: Fusion's materialization_incremental_duckdb can't find temp tables
- asana001-005: Fusion doesn't support +all_varchar seed config
- Restore +all_varchar in asana dbt_project.yml (needed for dbt-core)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
The +all_varchar seed config was removed from the asana dbt project,
so these variants no longer need to be disabled.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@joellabes joellabes merged commit f655099 into main Mar 6, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant