Add integration test for creating a TaskGroup by dbt project folder

[tatiana]

Follow up work to #1566, add additional tests to validate the feature:

1. Created a dbt project called multi_folder which helps test this feature.
2. Created and validated example DAGs both with DbtTaskGroup and DbtDag
3. Created and validated example DAG with Watcher

dbt Project multi_folder structure:

.
├── dbt_project.yml
├── models
│   ├── models_a
│   │   ├── dim_products.sql
│   │   └── stg_products.sql
│   └── models_b
│       └── stg_regions.sql
├── profiles.yml
└── seeds
    ├── seeds_a
    │   └── products.csv
    └── seeds_b
        ├── region_managers.csv
        └── regions.csv

Visualisation of the dbt Project multi_folder via dbt docs:

I validated the changes with the two new DAGs:

DbtDag with ExecutionMode.LOCAL

DbtTaskGroup with ExecutionMode.LOCAL

DbtDag with ExecutionMode.WATCHER

[Copilot]

Pull request overview

Adds an integration-test dbt project (dev/dags/dbt/multi_folder) and new integration tests to validate Cosmos’ RenderConfig(group_nodes_by_folder=True) behavior across DbtDag, DbtTaskGroup, and Watcher execution mode.

Changes:

• Add multi_folder dbt project fixture with multi-level models/ and seeds/ folder structure.
• Add integration tests asserting folder-based task IDs for DbtDag and DbtTaskGroup in local execution.
• Add integration test covering Watcher mode with group_nodes_by_folder=True and TestBehavior.AFTER_ALL.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
tests/operators/test_watcher.py	Adds Watcher-mode integration test validating folder-grouped task IDs and AFTER_ALL test task rendering.
tests/operators/test_local.py	Adds local-mode integration tests for folder-grouped rendering in both DbtDag and DbtTaskGroup.
dev/dags/dbt/multi_folder/dbt_project.yml	Defines the new dbt project used by the integration tests.
dev/dags/dbt/multi_folder/profiles.yml	Provides a standard env-var driven dbt profile for the new project (useful for example DAGs).
dev/dags/dbt/multi_folder/models/models_a/stg_products.sql	Seed-dependent model for folder-grouping coverage.
dev/dags/dbt/multi_folder/models/models_a/dim_products.sql	Downstream model to validate intra-folder dependencies.
dev/dags/dbt/multi_folder/models/models_b/stg_regions.sql	Model depending on multiple seeds in another folder.
dev/dags/dbt/multi_folder/seeds/seeds_a/products.csv	Seed fixture for folder grouping.
dev/dags/dbt/multi_folder/seeds/seeds_b/regions.csv	Seed fixture for folder grouping.
dev/dags/dbt/multi_folder/seeds/seeds_b/region_managers.csv	Seed fixture for folder grouping.
dev/dags/dbt/multi_folder/.gitignore	Ignores dbt build artifacts for the new project.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

[pankajkoti]

LGTM, thanks for adding this!

[pankajkoti]

Sorry, an afterthought, if possible, it may be a good idea to assert one of the dependencies between those tasks using depends on/ upstream tasks

[tatiana]

Sorry, an afterthought, if possible, it may be a good idea to assert one of the dependencies between those tasks using depends on/ upstream tasks

Thanks, @pankajkoti , just added this type of check in db25dde

[Copilot]

Pull request overview

Adds a new dbt project fixture (dev/dags/dbt/multi_folder) and new integration tests to validate Cosmos’ “group nodes by folder” rendering for both DbtDag/DbtTaskGroup (LOCAL) and DbtDag (WATCHER).

Changes:

• Add multi_folder dbt project fixture with multi-level models/ and seeds/ subfolders.
• Add LOCAL integration tests asserting task IDs/dependencies for folder-grouped rendering in DbtDag and DbtTaskGroup.
• Add WATCHER integration test asserting task IDs/dependencies (and AFTER_ALL test task) for folder-grouped rendering.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
tests/operators/test_watcher.py	Adds WATCHER-mode integration test targeting group_nodes_by_folder=True with TestBehavior.AFTER_ALL.
tests/operators/test_local.py	Adds LOCAL-mode integration tests for DbtDag and DbtTaskGroup with group_nodes_by_folder=True.
dev/dags/dbt/multi_folder/dbt_project.yml	Defines the new multi_folder dbt project and folder-based model materialization config.
dev/dags/dbt/multi_folder/profiles.yml	Adds a dbt profiles template for the new project (env-var driven).
dev/dags/dbt/multi_folder/models/models_a/stg_products.sql	Adds a model depending on the products seed.
dev/dags/dbt/multi_folder/models/models_a/dim_products.sql	Adds a downstream model depending on stg_products.
dev/dags/dbt/multi_folder/models/models_b/stg_regions.sql	Adds a model depending on regions and region_managers seeds.
dev/dags/dbt/multi_folder/seeds/seeds_a/products.csv	Adds seed data for products.
dev/dags/dbt/multi_folder/seeds/seeds_b/regions.csv	Adds seed data for regions.
dev/dags/dbt/multi_folder/seeds/seeds_b/region_managers.csv	Adds seed data for region_managers.
dev/dags/dbt/multi_folder/.gitignore	Ignores dbt build artifacts for the new project fixture.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.