Fix main branch failing tests

[tatiana]

Minimal changes on #2261 to see tests passing without changing the original branch

I also created a PR on the @YourRoyalLinus PR: YourRoyalLinus#1

This is a summary of the main issues:

(1) Some integration tests were failing with:

    ERROR tests/test_example_dags.py - AssertionError: assert not {'/home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/cosmos_manifest_selectors_example.py': 'Traceback (mo...he required Object Storage feature is unavailable in Airflow version 2.7.0. Please upgrade to Airflow 2.8 or later.\n'}
     +  where {'/home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/cosmos_manifest_selectors_example.py': 'Traceback (mo...he required Object Storage feature is unavailable in Airflow version 2.7.0. Please upgrade to Airflow 2.8 or later.\n'} = <airflow.models.dagbag.DagBag object at 0x7fa3c6e724d0>.import_errors
    ERROR tests/test_example_dags_no_connections.py - AssertionError: assert not {'/home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/cosmos_manifest_selectors_example.py': 'Traceback (mo...he required Object Storage feature is unavailable in Airflow version 2.7.0. Please upgrade to Airflow 2.8 or later.\n'}
     +  where {'/home/runner/work/astronomer-cosmos/astronomer-cosmos/dev/dags/cosmos_manifest_selectors_example.py': 'Traceback (mo...he required Object Storage feature is unavailable in Airflow version 2.7.0. Please upgrade to Airflow 2.8 or later.\n'} = <airflow.models.dagbag.DagBag object at 0x7fa3be1d89d0>.import_errors

The reason is "Object Storage feature is unavailable in Airflow version 2.7.0. Please upgrade to Airflow 2.8 or later". This is how you can fix it: 424a9a1

(2) dbt Fusion tests stopped working because the YAML selector file defined a default selector, which did not select any nodes in the jaffle_shop dbt project.

There were dbt Fusion tests that referenced the dbt project jaffle_shop that were changed and would actually run the DAG and check the DAG topology - including which nodes were rendered.

Since we set the default selector to not match any nodes, this behaviour changed:

=========================== short test summary info ============================
FAILED tests/test_dbtf.py::test_dbt_dag_with_dbt_fusion - assert 0 == 23
 +  where 0 = len({})
 +    where {} = <cosmos.dbt.graph.DbtGraph object at 0x7f0b68bb80d0>.filtered_nodes
 +      where <cosmos.dbt.graph.DbtGraph object at 0x7f0b68bb80d0> = <DAG: snowflake_dbt_fusion_dag>.dbt_graph

I moved the changes originally done to dev/dags/dbt/jaffle_shop to dev/dags/dbt/altered_jaffle_shop. I also removed the default selector definition.

(3) The DAG cosmos_manifest_selectors_examples.py failed to run in a clean database because it would attempt to run the dbt model customers, without having run its upstream tasks. This can be observed in https://github.com/astronomer/astronomer-cosmos/actions/runs/21476188465/job/61860709231?pr=2296

(4) The DAG example_cosmos_cleanup_dag.py is not compatible with Airflow 3. I logged a follow-up ticket for us to check this: #2300. This issue was not introduced by your PR. For now, it is skipped in AF3.

[Copilot]

Pull request overview

This PR addresses test failures and compatibility issues in PR #2261 by implementing minimal changes to ensure all checks pass. The changes focus on fixing integration test failures, adding Airflow 3 compatibility, and ensuring proper YAML selector support for LoadMode.DBT_MANIFEST.

Changes:

• Fixed integration tests failing due to Object Storage feature unavailability in Airflow 2.7
• Added Airflow 3 compatibility by skipping incompatible DAGs
• Enabled YAML selector support for LoadMode.DBT_MANIFEST with comprehensive caching

Reviewed changes

Copilot reviewed 18 out of 20 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
tests/test_example_dags.py	Added cosmos_manifest_selectors_example.py to minimum version requirements and Airflow 3 compatibility
tests/test_example_dags_no_connections.py	Added cosmos_manifest_selectors_example.py to ignored files and Airflow 3 skip logic
tests/test_cache.py	Renamed delete_unused_dbt_ls_cache to delete_unused_dbt_cache and added YAML selector cache tests
tests/dbt/test_selector.py	Added comprehensive YAML selector parsing tests
tests/dbt/test_graph.py	Added tests for YAML selector loading and caching functionality
cosmos/dbt/selector.py	Implemented YamlSelectors class for parsing manifest selectors
cosmos/dbt/graph.py	Added YAML selector cache methods and integrated with manifest loading
cosmos/config.py	Added airflow_vars_to_purge_dbt_yaml_selectors_cache parameter
cosmos/cache.py	Refactored cache deletion functions and added YAML selector cache support
cosmos/settings.py	Added enable_cache_dbt_yaml_selectors configuration
docs/configuration/*.rst	Updated documentation for YAML selector support
dev/dags/cosmos_manifest_selectors_example.py	Added example DAG demonstrating YAML selector usage
dev/dags/dbt/altered_jaffle_shop/selectors.yml	Added selector definitions for testing
dev/dags/example_cosmos_cleanup_dag.py	Added YAML selector cache cleanup functions

Comments suppressed due to low confidence (1)

cosmos/dbt/graph.py:1

• The assertion now expects only one hash value for macOS (within a tuple), but the comment on line 2082 mentions 'versions' plural. This inconsistency should be resolved - either update the comment to match the single value or explain why only one hash is now expected compared to the previous two values.

from __future__ import annotations

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

[YourRoyalLinus]

Thank you for fixing these! This LGTM.

The default keyword in the selectors.yml was an artifact from when I was testing if yaml parsing can/should support that behavior. I missed it when I was cleaning up those changes. Sorry for the headache and glad it seemed you were able to spot it quickly