Add DBT project to run benchmark for async execution mode

[pankajastro]

This PR introduces a DBT project setup to benchmark async execution mode performance.

• The project currently includes 4 additional models, 1 seed + jaffle_shop project resouces.
• A script benchmark/auto_generate_models.sh is available to generate additional models if needed for scaling benchmarks.
• The DAG takes approximately 13–14 minutes to complete if 30 models are generated and run
• Benchmark runtime can be increased by adjusting the configuration in dbt/altered_jaffle_shop/seeds/model_params.csv, which allows simulation of time-consuming transformation.

This setup will help in evaluating how async execution mode scales with larger DAGs and more resource-intensive transformations.

closes: https://github.com/astronomer/oss-integrations-private/issues/175

[Copilot]

Pull Request Overview

Adds a focused dbt project and Airflow DAG to benchmark async execution performance using Cosmos and BigQuery, with seeds and “slow” models to inflate runtime and a script to scale model count.

• Introduces altered_jaffle_shop dbt project with seeds, staging, core, and heavy benchmarking models.
• Adds an Airflow DbtDag configured for AIRFLOW_ASYNC execution and a script to auto-generate additional long-running models.
• Provides configurable model parameters via a seed to control workload size.

Reviewed Changes

Copilot reviewed 24 out of 29 changed files in this pull request and generated 9 comments.

Show a summary per file

File	Description
dbt/altered_jaffle_shop/seeds/raw_payments.csv	Seed data for payments used by staging model.
dbt/altered_jaffle_shop/seeds/raw_orders.csv	Seed data for orders used by staging model.
dbt/altered_jaffle_shop/seeds/raw_customers.csv	Seed data for customers used by staging model.
dbt/altered_jaffle_shop/seeds/model_params.csv	Seed controlling workload parameters for long models.
dbt/altered_jaffle_shop/profiles.yml	Example dbt profile for BigQuery (likely unused with Cosmos mapping).
dbt/altered_jaffle_shop/models/staging/stg_payments.sql	Staging model converting cents to dollars.
dbt/altered_jaffle_shop/models/staging/stg_orders.sql	Staging model for orders.
dbt/altered_jaffle_shop/models/staging/stg_customers.sql	Staging model for customers.
dbt/altered_jaffle_shop/models/schema.yml	Schema tests and docs for orders and customers.
dbt/altered_jaffle_shop/models/orders.sql	Orders fact model aggregating payments by method.
dbt/altered_jaffle_shop/models/long_model_text_processing.sql	Heavy text-processing benchmark model.
dbt/altered_jaffle_shop/models/long_model_subquery_windows.sql	Heavy windowing benchmark model.
dbt/altered_jaffle_shop/models/long_model_cross_random.sql	Heavy cross-join benchmark model.
dbt/altered_jaffle_shop/models/docs.md	Docs for order status values.
dbt/altered_jaffle_shop/models/customers_slow_query.sql	Heavy windowing workload over customers.
dbt/altered_jaffle_shop/models/customers.sql	Customers mart model.
dbt/altered_jaffle_shop/macros/get_model_param.sql	Macro intended to read params from a seed.
dbt/altered_jaffle_shop/dbt_project.yml	Project config (profile name, paths, defaults).
dbt/altered_jaffle_shop/README.md	Project usage notes.
dbt/altered_jaffle_shop/.user.yml	User metadata.
dbt/altered_jaffle_shop/.gitignore	Ignore dbt artifacts.
dags/cosmos_async_dag.py	Airflow DAG using Cosmos with AIRFLOW_ASYNC.
benchmark/auto_generate_models.sh	Script to replicate long models for scaling.
README.md	Repository-level readme mentions new project and how to scale models.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[pankajkoti]

LGTM, but have some comments inline if you could check and address once before merging.

Hoping that we have tested the benchmark with these scripts.

[pankajkoti]

Happy to merge once we have tested benchmarking with the latest changes and the comments are addressed.

[pankajastro]

Happy to merge once we have tested benchmarking with the latest changes and the comments are addressed.

Tested against updated commit