Fix running tests with dbt Fusion 2.0.0 preview versions

[tatiana]

The dbt Fusion tests in Cosmos' main branch were failing with errors like:

>           raise CosmosLoadDbtException(f"Unable to run {command} due to the error:\n{details}")
E           cosmos.dbt.graph.CosmosLoadDbtException: Unable to run ['/home/runner/.local/bin/dbt', 'ls', '--output', 'json', '--output-keys', 'name', 'unique_id', 'resource_type', 'depends_on', 'original_file_path', 'tags', 'config', 'freshness', '--project-dir', '/tmp/tmp5viijrkb', '--profiles-dir', '/home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/dbt/jaffle_shop', '--profile', 'snowflake_profile', '--target', 'dev'] due to the error:
E           stderr: error: dbt1060: Ignored unexpected key 'materialized'. Try '+materialized' instead. YAML path: 'jaffle_shop.materialized'.
E             --> dbt_project.yml:24:21
E           error: dbt1060: Ignored unexpected key 'materialized'. Try '+materialized' instead. YAML path: 'jaffle_shop.staging.materialized'.
E             --> dbt_project.yml:26:23
E           error: dbt0102: Deprecated test arguments: ["values"] at top-level detected. Please migrate to the new format under the 'arguments' field: https://docs.getdbt.com/reference/deprecations#missingargumentspropertyingenerictestdeprecation.
E             --> models/schema.yml:58:23
E           error: dbt0102: Deprecated test arguments: ["values"] at top-level detected. Please migrate to the new format under the 'arguments' field: https://docs.getdbt.com/reference/deprecations#missingargumentspropertyingenerictestdeprecation.
E             --> models/staging/schema.yml:20:23
E           error: dbt0102: Deprecated test arguments: ["values"] at top-level detected. Please migrate to the new format under the 'arguments' field: https://docs.getdbt.com/reference/deprecations#missingargumentspropertyingenerictestdeprecation.
E             --> models/staging/schema.yml:31:23
E           
E           stdout: dbt-fusion 2.0.0-preview.3
E              Loading ../../home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/dbt/jaffle_shop/profiles.yml
E              Loading packages.yml
E           suggestion: Run 'dbt deps' to see the latest fusion compatible packages. For compatibility errors, try the autofix script: https://github.com/dbt-labs/dbt-autofix
E             Finished 'ls' target 'dev' with 5 errors in 91ms

Example:
https://github.com/astronomer/astronomer-cosmos/actions/runs/17485309398/job/49663095838?pr=1947

This issue is due to breaking changes introduced in the dbt schema and dbt project syntax as part of the dbt Fusion promotion (and only back-ported to dbt Core 1.10). The latest versions of dbt Fusion no longer accept the previous syntax, which was supported by dbt versions 1.9 and earlier.

This PR:

• Changes the jaffle_shop so that it is compatible with the new syntax. This has fixed the dbt Fusion tests.
• For tests that need to run with dbt Core versions before 1.10, modify the DAGs to use altered_jaffle_shop, allowing us to maintain both project syntaxes and validate against both versions. We must support dbt Core 1.9, as it has not yet reached the end of life (https://docs.getdbt.com/docs/dbt-versions/core).

There were a few changes to the CI, and a successful test run against these new configurations can be seen at:
https://github.com/astronomer/astronomer-cosmos/actions/runs/17733688014/job/50390249064

Tests worked with dbt Fusion 2.0.0 preview 13.

Closes: #1929

[netlify]

✅ Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name	Link
🔨 Latest commit	b111bdc
🔍 Latest deploy log	https://app.netlify.com/projects/sunny-pastelito-5ecb04/deploys/68c814db7822ae00083bd3c6

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 98.04%. Comparing base (1854f9e) to head (4cb37e1).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1948   +/-   ##
=======================================
  Coverage   98.04%   98.04%           
=======================================
  Files          86       86           
  Lines        5321     5321           
=======================================
  Hits         5217     5217           
  Misses        104      104           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[Copilot]

Pull Request Overview

This PR fixes compatibility issues with dbt Fusion 2.0.0 preview versions by updating the dbt project syntax to use the new format required by dbt Fusion and maintaining backward compatibility for older dbt Core versions.

• Updates jaffle_shop project syntax to use +materialized instead of materialized and fixes test schema to use the new arguments format
• Adds environment variable support for specifying different dbt project names to allow testing with both old and new syntax versions
• Modifies CI configuration to use altered_jaffle_shop for tests with dbt versions before 1.10 while using the updated jaffle_shop for newer versions

Reviewed Changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
tests/test_example_dags.py	Adds functions to support testing single DAGs and environment-based project selection
tests/dbt/test_graph.py	Updates hash values for cache tests due to project structure changes
scripts/test/integration.sh	Excludes simple_dag_async from integration tests
scripts/test/integration-dbt-1-5-4.sh	Updates test command format and adds environment variables for older dbt versions
dev/dags/simple_dag_async.py	Adds environment variable support for dynamic project path selection
dev/dags/dbt/jaffle_shop/models/staging/schema.yml	Updates test syntax to use new arguments format
dev/dags/dbt/jaffle_shop/models/schema.yml	Updates test syntax to use new arguments format
dev/dags/dbt/jaffle_shop/dbt_project.yml	Updates materialization config to use +materialized prefix
dev/dags/basic_cosmos_task_group.py	Adds environment variable support for dynamic project path selection
dev/dags/basic_cosmos_dag_full_module_path_imports.py	Adds environment variable support for dynamic project path selection
dev/dags/basic_cosmos_dag.py	Adds environment variable support for dynamic project path selection
.github/workflows/test.yml	Updates CI configuration to use different projects for different dbt versions

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[pankajkoti]

Looks good, some questions inline.

[pankajkoti]

Is there a reason we need to move those environment variables here? Our other jobs have most of the environment variables localised to the step that runs the tests.

[tatiana]

I didn't realise we were trying to keep the envvars closer to the step, sorry. We can revert this change in a future change to test.yml! Please, feel free to create a PR with this change