docs: Improve AIRFLOW_ASYNCdocs#2103
Merged
Merged
Conversation
- Encourage high performance configuration by default - Avoid information duplication
✅ Deploy Preview for sunny-pastelito-5ecb04 ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
Contributor
There was a problem hiding this comment.
Pull Request Overview
This PR improves the documentation for Cosmos's ExecutionMode.AIRFLOW_ASYNC mode by encouraging high-performance defaults and eliminating duplicate information. The changes update execution mode comparison tables, restructure documentation to highlight performance benefits, and move detailed implementation information to a dedicated async execution mode guide.
Key changes:
- Updated performance metrics in comparison tables to reflect "Very Fast" for async modes
- Added performance benchmarks showing 35% improvement over local execution
- Reorganized content to reduce duplication between overview and detailed guide
Reviewed Changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.
| File | Description |
|---|---|
| docs/getting_started/execution-modes.rst | Updated comparison table, streamlined async mode overview by removing duplicated implementation details |
| docs/getting_started/async-execution-mode.rst | Enhanced guide with performance benchmarks, restructured advantages section, added clearer limitations, and included optimal configuration guidance |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
pankajkoti
approved these changes
Nov 10, 2025
Contributor
pankajkoti
left a comment
pankajkoti
left a comment
There was a problem hiding this comment.
Looks good. Have some questions/suggestions inline if you'd like to consider.
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
tatiana
commented
Nov 10, 2025
Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
tatiana
commented
Nov 10, 2025
tatiana
commented
Nov 10, 2025
tatiana
commented
Nov 10, 2025
tatiana
commented
Nov 10, 2025
tatiana
commented
Nov 11, 2025
tatiana
commented
Nov 11, 2025
tatiana
commented
Nov 11, 2025
tatiana
commented
Nov 11, 2025
tatiana
commented
Nov 11, 2025
tatiana
commented
Nov 11, 2025
tatiana
added a commit
that referenced
this pull request
Nov 12, 2025
Further improve the `ExecutionMode.AIRFLOW_ASYNC`documentation by: - Encourage high performance configuration by default - Avoid information duplication (cherry picked from commit 80f1678)
Merged
tatiana
added a commit
that referenced
this pull request
Nov 12, 2025
Bug fixes * Fix ``ExecutionMode.WATCHER`` deadlock in Airflow 3.0 & 3.1 by @tatiana in #2087 * Fix ``ExecutionMode.AIRFLOW_ASYNC`` ``TaskGroup`` XCom issue by @tatiana in #2088 * Guard watcher callback exceptions to avoid hanging producer tasks by @pankajkoti in #2101 * Fix SQL templated field rendering for dynamically mapped tasks in Airflow 2 by @tatiana in #2119 Enhancements * Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073 Docs * Improve ``ExecutionMode.AIRFLOW_ASYNC`` docs by @tatiana in #2103 * Add note about experimenting threads count for the Watcher Execution mode by @pankajkoti in #2083 * Fix minor documentation formatting issue by @dnskrv in #2098 * Correct example YAML key from ``operator_args`` to ``operator_kwargs`` by @jx2lee in #2091 Others * Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076 * pre-commit autoupdate in #2078, #2104 related: astronomer/oss-integrations-private#272
Merged
tatiana
added a commit
that referenced
this pull request
Nov 13, 2025
Bug fixes * Fix ``ExecutionMode.WATCHER`` deadlock in Airflow 3.0 & 3.1 by @tatiana in #2087 * Fix ``ExecutionMode.AIRFLOW_ASYNC`` ``TaskGroup`` XCom issue by @tatiana in #2088 * Guard watcher callback exceptions to avoid hanging producer tasks by @pankajkoti in #2101 * Fix SQL templated field rendering for dynamically mapped tasks in Airflow 2 by @tatiana in #2119 Enhancements * Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073 Docs * Improve ``ExecutionMode.AIRFLOW_ASYNC`` docs by @tatiana in #2103 * Add note about experimenting threads count for the Watcher Execution mode by @pankajkoti in #2083 * Fix minor documentation formatting issue by @dnskrv in #2098 * Correct example YAML key from ``operator_args`` to ``operator_kwargs`` by @jx2lee in #2091 Others * Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076 * pre-commit autoupdate in #2078, #2104 Closes: astronomer/oss-integrations-private#272
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Further improve the
ExecutionMode.AIRFLOW_ASYNCdocumentation by: