Skip to content

Use schedule param in example DAGs instead of 2.10 deprecated and 3.0 removed schedule_interval#1701

Merged
pankajkoti merged 1 commit into
mainfrom
change-schedule-arg-in-dags
Apr 28, 2025
Merged

Use schedule param in example DAGs instead of 2.10 deprecated and 3.0 removed schedule_interval#1701
pankajkoti merged 1 commit into
mainfrom
change-schedule-arg-in-dags

Conversation

@pankajkoti
Copy link
Copy Markdown
Contributor

Created this isolated PR to alter example DAG changes while working on PR #1646

related: #1631
related: #1646

Copilot AI review requested due to automatic review settings April 28, 2025 06:44
@dosubot dosubot Bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Apr 28, 2025
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the example DAGs and test definitions to replace the deprecated schedule_interval parameter with the new schedule parameter, in line with recent Airflow version changes.

  • Replaces schedule_interval with schedule in multiple DAG definitions and tests.
  • Aligns scheduling parameters in various example files for consistency with the updated API.

Reviewed Changes

Copilot reviewed 20 out of 20 changed files in this pull request and generated no comments.

Show a summary per file
File Description
tests/operators/test_airflow_async.py Updated test operator initialization to use schedule instead of schedule_interval.
dev/dags/user_defined_profile.py Replaced schedule_interval with schedule in DAG decorator.
dev/dags/performance_dag.py Updated DAG parameters to utilize schedule instead of schedule_interval.
dev/dags/example_tasks_map.py Changed DAG scheduling parameter for clarity and consistency.
dev/dags/example_taskflow.py Updated the DAG decorator to use the schedule parameter.
dev/dags/example_task_mapping.py Replaced schedule_interval with schedule in task mapping DAG.
dev/dags/example_source_rendering.py Changed scheduling parameter to align with updated API.
dev/dags/example_model_version.py Updated the scheduling parameter to use schedule.
dev/dags/example_dbt_deps.py Replaced schedule_interval with schedule in the DAG definition.
dev/dags/example_cosmos_sources.py Updated DAG scheduling parameter for consistency.
dev/dags/example_cosmos_python_models.py Replaced schedule_interval with schedule for clarity.
dev/dags/example_cosmos_dbt_build.py Updated scheduling parameter to use schedule instead of schedule_interval.
dev/dags/example_cosmos_cleanup_dag.py Changed schedule_interval to schedule while retaining comments.
dev/dags/dbt_docs.py Updated the scheduling parameter in the DAG definition.
dev/dags/cosmos_seed_dag.py Replaced schedule_interval with schedule to update scheduling API usage.
dev/dags/cosmos_profile_mapping.py Changed scheduling parameter to schedule for clarity.
dev/dags/cosmos_manifest_example.py Updated DAG decorator to use schedule instead of schedule_interval.
dev/dags/cosmos_callback_dag.py Replaced schedule_interval with schedule for consistency.
dev/dags/basic_cosmos_task_group_different_owners.py Updated scheduling parameter in the DAG declaration.
dev/dags/basic_cosmos_dag.py Replaced schedule_interval with schedule for API compliance.

@pankajkoti pankajkoti changed the title Use schedule param in example DAGs instead of 2.10 deprecate and 3.0 removed schedule_interval Use schedule param in example DAGs instead of 2.10 deprecated and 3.0 removed schedule_interval Apr 28, 2025
@netlify
Copy link
Copy Markdown

netlify Bot commented Apr 28, 2025

Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name Link
🔨 Latest commit 2bf7dfa
🔍 Latest deploy log https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/680f23e7508ac0000896e160

@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 28, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.43%. Comparing base (b55f202) to head (2bf7dfa).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1701   +/-   ##
=======================================
  Coverage   97.43%   97.43%           
=======================================
  Files          81       81           
  Lines        5024     5024           
=======================================
  Hits         4895     4895           
  Misses        129      129           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pankajkoti pankajkoti merged commit 62b0088 into main Apr 28, 2025
74 checks passed
@pankajkoti pankajkoti deleted the change-schedule-arg-in-dags branch April 28, 2025 07:08
@pankajkoti pankajkoti restored the change-schedule-arg-in-dags branch April 28, 2025 07:09
@pankajkoti pankajkoti mentioned this pull request Apr 30, 2025
@tatiana tatiana added this to the Cosmos 1.10.0 milestone Apr 30, 2025
tatiana added a commit that referenced this pull request May 1, 2025
Features

* Airflow 3 support
* Support running ``dbt deps`` incrementally to pre-defined
``dbt_packages`` by @tatiana in #1668 and #1670
* Add ``DuckDB`` profile mapping by @prithvijitguha and @pankajastro in
#1553
* Implement DBT exposure selector by ghjklw #1717

Bug Fixes

* Fix ``test_indirect_selection`` flag to be propagated in case of
``TestBehavior.BUILD`` by @corsettigyg in #1663
* Fix ``select`` clause in the case of detached tests by @anyapriya in
#1680
* Operator argument fixes by @johnhoran in #1648


Airflow 3 Support

* Support rendering DbtDag in Airflow 3 by @tatiana and @ashb in #1657
* Refactor Rendered Task Instance Fields (RTIF) handling for Airflow 2.x
and 3.x by @pankajkoti in #1661
* Run cosmos operator in Airflow 3 by @pankajastro in #1642
* Fix ``python_virtualenv.prepare_env`` top-level import for Airflow 3
by @pankajkoti in #1678
* Fix Variable not found issue in Airflow 3 by @tatiana in #1684
* Disable CosmosPlugin on Airflow 3 setup by @pankajkoti in #1692, #1698
* Use ``schedule`` param in example DAGs instead of the 2.10 deprecated
and 3.0 removed ``schedule_interval`` by @pankajkoti in #1701
* Ensure ``virtualenv_dir`` path exists by @pankajkoti in #1724
* Support emitting Assets with Airflow 3 by @tatiana in #1713
* Add docs on Airflow 3 compatibility by @pankajkoti and @tatiana in
#1731
* Introduce, test and document asset/dataset breaking change by @tatiana
in #1672
* Improve dataset/asset driven scheduling documentation by @tatiana in
#1729

Enhancements

* Allow multiple callbacks by @corsettigyg #1693
* Refactor kubernetes warning callback handling by @canbekley in #1681

Documentation

* Add documentation related to ``copy_dbt_packages`` by @tatiana in
#1671
* Make wording and command consistent in the contributing doc by
@pankajkoti in #1697
* Add MonteCarlo callback example for importing dbt artifacts by
@corsettigyg #1695
* Change async feature to be non-experimental by @tatiana in #1732

Others

* Add sample ``dbt_packages`` to validate incremental ``dbt deps`` by
@tatiana in #1669
* Add kubernetes execution mode example in Airflow 3 by @pankajastro in
#1667
* Check only major version until Airflow 3 stable release by
@pankajastro in #1665
* Install Airflow from main branch by @pankajastro in #1660
* Add dev tool for Airflow 3 by @pankajastro and @tatiana in #1627
* Improve Airflow 3 tooling by @pankajastro in #1656
* Skip associating ``openlineage_events_completes`` to ``ti`` in Airflow
3 by @pankajkoti in #1662
* Add .gitignore file for the scripts/airflow3 directory by @pankajkoti
in #1658
* Remove ``original_jaffle_shop`` dbt project by @pankajkoti in #1676
* Fix or ignore type check error by @pankajastro in #1687
* Run virtualenv example with Airflow 3 tooling by @pankajastro in #1686
* Enable running setup/teardown tasks with Async execution DAG with
Airflow 3 tooling by @pankajastro in #1696
* Enable integration tests for the DuckDB adapter by @pankajastro in
#1699
* Add Airflow 3 tests matrix entries in CI by @pankajkoti in #1646
* Use a different way to get tasks count for asserting test_perf_dag by
@pankajkoti in #1714
* Reinstall Airflow 3 dependency on ``pydantic>=2.11`` for dbt adapter
versions 1.6 & 1.9 by @pankajkoti in #1715
* Fix outdated ``echo`` in Airflow 3 tooling script #1700
* Add files not needed for git tracking to .gitignore by @pankajkoti in
#1723
* Use latest minor versions for dbt adapters to get in compatibility
fixes by @pankajkoti in #1719
* Fix Airflow 3 tests raising generate_run_id() takes 0 positional
arguments by @tatiana in #1725
* Fix dataset tests failing in Airflow 3 by @tatiana in #1716
* Enable example DAGs to run in CI that were disabled in PR #1646 by
@pankajkoti in #1726
* Pre-commit updates: #1666, #1653, #1641, #1682, #1720


Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
Co-authored-by: Pankaj Singh
<98807258+pankajastro@users.noreply.github.com>

---------

Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M This PR changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants