Release 1.11.2#2159
Merged
Merged
Conversation
I discovered that `full_refresh` is ignored when running in the `WATCHER` execution mode. This can be easily fixed by using the `DbtBuildMixin` in the producer operator. Furthermore, we can use the base_cmd from this mixin. This simplifies the operator and also fixes the missing `full_refresh` flag. Closes: #2113 (cherry picked from commit 233d2e3)
The PR makes the following changes: - hard-set `DbtProducerWatcherOperator` `retries` (and `default_args["retries"]`) to zero so WATCHER never auto-retries the full dbt build - Log at INFO that producer retries are disabled, and fail fast if Airflow attempts a retry (try number > 1), improving user visibility into the behavior. - explain the rationale inline (sensor retry path handles per-model reruns) - document behavior in the WATCHER guide and add tests covering the forced retry value closes: #2105 --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> (cherry picked from commit b58778b)
…2143) This PR updates the AirflowAsync execution mode documentation to clarify a current limitation where dataset events are not emitted. This addresses the documentation issue tracked in #2142. ## Related Issue(s) related: #2142 --------- Co-authored-by: Vara Prasad Regani <varaprasadregani@Varas-MacBook-Pro.local> Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com> Co-authored-by: Kalyan R <kalyan.ben10@live.com> (cherry picked from commit e195b70)
Add missing dependency. Improve English. (cherry picked from commit 53c0d34)
…ow context (#2126) Ensure `DbtConsumerWatcherSensor` uses the Airflow context to fail fast when the watcher producer ends in a failure state. related: #2086 --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> (cherry picked from commit a59011e)
tatiana
approved these changes
Nov 24, 2025
Collaborator
tatiana
left a comment
There was a problem hiding this comment.
Looks great, @pankajkoti , thank you! ![]()
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bug fixes
DbtProducerWatcherOperatorretries to zero by @pankajkoti in Force watcher producer retries to zero #2114DbtConsumerWatcherSensortasks immediately when theDbtProducerWatcherOperatorfails using Airflow context by @pankajkoti in Fail consumer sensors when producer task failure observed using Airflow context #2126DbtProducerWatcherOperatordbt buildflags by by @michal-mrazek in Fix forwardingDbtProducerWatcherOperatordbt build flags #2127Documentation
ExecutionMode.KUBERNETESguidance by @tatiana in Improve docs onExecutionMode.KUBERNETES#2139ExecutionMode.AIRFLOW_ASYNCby @varaprasadregani in docs: add limitation on dataset events missing in AIRFLOW_ASYNC mode #2143related: https://github.com/astronomer/oss-integrations-private/issues/274