Skip to content

Fix Airflow dependencies in the CI#1773

Merged
tatiana merged 1 commit into
mainfrom
fix-airflow-deps
May 20, 2025
Merged

Fix Airflow dependencies in the CI#1773
tatiana merged 1 commit into
mainfrom
fix-airflow-deps

Conversation

@tatiana
Copy link
Copy Markdown
Collaborator

@tatiana tatiana commented May 20, 2025

Our CI tests have been quite unstable lately; this PR aims to fix the most recent issues.

Our CI tests have been quite unstable lately, this PR aims to fix the most recent issues.
Copilot AI review requested due to automatic review settings May 20, 2025 15:20
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot wasn't able to review any files in this pull request.

Files not reviewed (1)
  • scripts/test/pre-install-airflow.sh: Language not supported

@netlify
Copy link
Copy Markdown

netlify Bot commented May 20, 2025

Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name Link
🔨 Latest commit 422fd2c
🔍 Latest deploy log https://app.netlify.com/projects/sunny-pastelito-5ecb04/deploys/682c9dbb1e120800083262a1

@dosubot dosubot Bot added the size:M This PR changes 30-99 lines, ignoring generated files. label May 20, 2025
@cloudflare-workers-and-pages
Copy link
Copy Markdown

Deploying astronomer-cosmos with  Cloudflare Pages  Cloudflare Pages

Latest commit: 422fd2c
Status: ✅  Deploy successful!
Preview URL: https://ba853486.astronomer-cosmos.pages.dev
Branch Preview URL: https://fix-airflow-deps.astronomer-cosmos.pages.dev

View logs

@dosubot dosubot Bot added area:ci Related to CI, Github Actions, or other continuous integration tools area:dependencies Related to dependencies, like Python packages, library versions, etc labels May 20, 2025
Copy link
Copy Markdown
Contributor

@pankajkoti pankajkoti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving so that we can rebase this in other PRs if needed.

@tatiana
Copy link
Copy Markdown
Collaborator Author

tatiana commented May 20, 2025

Thanks, @pankajkoti , since the issues were being raised during installation, and these have been passed - I'm merging this PR

@tatiana tatiana merged commit eb8114a into main May 20, 2025
90 checks passed
@tatiana tatiana deleted the fix-airflow-deps branch May 20, 2025 15:39
@tatiana tatiana added this to the Cosmos 1.10.1 milestone May 20, 2025
@codecov
Copy link
Copy Markdown

codecov Bot commented May 20, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.71%. Comparing base (15a8d91) to head (422fd2c).
Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1773   +/-   ##
=======================================
  Coverage   97.71%   97.71%           
=======================================
  Files          84       84           
  Lines        5252     5252           
=======================================
  Hits         5132     5132           
  Misses        120      120           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

pankajkoti pushed a commit that referenced this pull request May 21, 2025
Our CI tests have been quite unstable lately; this PR aims to fix the
most recent issues.

(cherry picked from commit eb8114a)
pankajkoti added a commit that referenced this pull request May 21, 2025
Bug Fixes

* Fix ``full_refresh`` parameter in ``AIRFLOW_ASYNC``
``ExecutionConfig`` mode by @tuantran0910 in #1738
* Fix dbt ls invocation method log message by @tatiana and @dstandish in
#1749
* Ensure remote target directory is created when copying files when
using local directory by @tuantran0910 and @corsettigyg in #1740
* Support custom ``packages-install-path`` by @tatiana in #1768
* Disable dbt static parser during Airflow task execution using dbt
runner by @pankajkoti and @tatiana in #1760
* Fix ``ExecutionMode.LOCAL`` to leverage
``ProjectConfig.manifest_path`` by @tatiana in #1772
* Refactor ``AIRFLOW_ASYNC`` so that the path in the remote object store
is specific per DAG run by @tuantran0910 in #1741
* Optimise memory usage with optional explicit imports by @pankajkoti
and @tatiana in #1769

Documentation

* Fix documentation rendering for ``use_dataset_airflow3_uri_standard``
by @pankajastro in #1742
* Correct custom callback example by @walter9388 in #1747

Others

* Re-enable integration tests durations to troubleshoot performance
degradation by @tatiana in #1735
* Run listener tests for Airflow 3 by @pankajastro in #1743
* Add Airflow 3 db files to ignore from git tracking by @pankajkoti in
#1755
* Log contents of ``packages.yml`` when
``AIRFLOW__LOGGING__LOGGING_LEVEL=DEBUG`` by @tatiana in #1764
* Fix Airflow dependencies in the CI by @tatiana in #1773
* Pre-commit updates: #1744, #1765, #1770
pankajkoti added a commit that referenced this pull request May 21, 2025
Bug Fixes

* Fix ``full_refresh`` parameter in ``AIRFLOW_ASYNC``
``ExecutionConfig`` mode by @tuantran0910 in #1738
* Fix dbt ls invocation method log message by @tatiana and @dstandish in
#1749
* Ensure remote target directory is created when copying files when
using local directory by @tuantran0910 and @corsettigyg in #1740
* Support custom ``packages-install-path`` by @tatiana in #1768
* Disable dbt static parser during Airflow task execution using dbt
runner by @pankajkoti and @tatiana in #1760
* Fix ``ExecutionMode.LOCAL`` to leverage
``ProjectConfig.manifest_path`` by @tatiana in #1772
* Refactor ``AIRFLOW_ASYNC`` so that the path in the remote object store
is specific per DAG run by @tuantran0910 in #1741
* Optimise memory usage with optional explicit imports by @pankajkoti
and @tatiana in #1769

Documentation

* Fix documentation rendering for ``use_dataset_airflow3_uri_standard``
by @pankajastro in #1742
* Correct custom callback example by @walter9388 in #1747

Others

* Re-enable integration tests durations to troubleshoot performance
degradation by @tatiana in #1735
* Run listener tests for Airflow 3 by @pankajastro in #1743
* Add Airflow 3 db files to ignore from git tracking by @pankajkoti in
#1755
* Log contents of ``packages.yml`` when
``AIRFLOW__LOGGING__LOGGING_LEVEL=DEBUG`` by @tatiana in #1764
* Fix Airflow dependencies in the CI by @tatiana in #1773
* Pre-commit updates: #1744, #1765, #1770


---------

(cherry picked from commit 430be00)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:ci Related to CI, Github Actions, or other continuous integration tools area:dependencies Related to dependencies, like Python packages, library versions, etc size:M This PR changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants