Skip to content

fix(gtf): set dedup_key on atomic sql#37820

Merged
villebro merged 2 commits intoapache:masterfrom
villebro:villebro/gtf-fixes-1
Feb 10, 2026
Merged

fix(gtf): set dedup_key on atomic sql#37820
villebro merged 2 commits intoapache:masterfrom
villebro:villebro/gtf-fixes-1

Conversation

@villebro
Copy link
Member

@villebro villebro commented Feb 9, 2026

SUMMARY

A few fixes to the initial GTF implementation in #36368 :

  • Atomic SQL wasn't updating dedup_key, making completed tasks blocking. This fixes the issue, adds unit tests and adds dedup_key to the task schema for easier debugging.
  • Fixes some typos in the docs.
  • Some general slop cleanup.

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

ADDITIONAL INFORMATION

  • Has associated issue:
  • Required feature flags:
  • Changes UI
  • Includes DB Migration (follow approval process in SIP-59)
    • Migration is atomic, supports rollback & is backwards-compatible
    • Confirm DB migration upgrade and downgrade tested
    • Runtime estimates and downtime expectations provided
  • Introduces new feature or API
  • Removes existing feature or API

@bito-code-review
Copy link
Contributor

bito-code-review bot commented Feb 10, 2026

Code Review Agent Run #614810

Actionable Suggestions - 0
Review Details
  • Files reviewed - 6 · Commit Range: 537e545..537e545
    • superset-core/src/superset_core/api/tasks.py
    • superset/daos/tasks.py
    • superset/models/tasks.py
    • superset/tasks/manager.py
    • superset/tasks/schemas.py
    • tests/unit_tests/daos/test_tasks.py
  • Files skipped - 1
    • docs/developer_portal/extensions/tasks.md - Reason: Filter setting
  • Tools
    • Whispers (Secret Scanner) - ✔︎ Successful
    • Detect-secrets (Secret Scanner) - ✔︎ Successful
    • MyPy (Static Code Analysis) - ✔︎ Successful
    • Astral Ruff (Static Code Analysis) - ✔︎ Successful

Bito Usage Guide

Commands

Type the following command in the pull request comment and save the comment.

  • /review - Manually triggers a full AI review.

  • /pause - Pauses automatic reviews on this pull request.

  • /resume - Resumes automatic reviews.

  • /resolve - Marks all Bito-posted review comments as resolved.

  • /abort - Cancels all in-progress reviews.

Refer to the documentation for additional commands.

Configuration

This repository uses Superset You can customize the agent settings here or contact your Bito workspace admin at evan@preset.io.

Documentation & Help

AI Code Review powered by Bito Logo

@github-actions github-actions bot added the doc Namespace | Anything related to documentation label Feb 10, 2026
@dosubot dosubot bot added the change:backend Requires changing the backend label Feb 10, 2026
@netlify
Copy link

netlify bot commented Feb 10, 2026

Deploy Preview for superset-docs-preview ready!

Name Link
🔨 Latest commit 537e545
🔍 Latest deploy log https://app.netlify.com/projects/superset-docs-preview/deploys/698a74ff2ee3c90008f08a9e
😎 Deploy Preview https://deploy-preview-37820--superset-docs-preview.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@codecov
Copy link

codecov bot commented Feb 10, 2026

Codecov Report

❌ Patch coverage is 78.57143% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 66.67%. Comparing base (59dd2fa) to head (c880fb7).
⚠️ Report is 12 commits behind head on master.

Files with missing lines Patch % Lines
superset/tasks/manager.py 25.00% 2 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           master   #37820       +/-   ##
===========================================
+ Coverage        0   66.67%   +66.67%     
===========================================
  Files           0      671      +671     
  Lines           0    51597    +51597     
  Branches        0     5771     +5771     
===========================================
+ Hits            0    34403    +34403     
- Misses          0    15810    +15810     
- Partials        0     1384     +1384     
Flag Coverage Δ
hive 41.50% <35.71%> (?)
mysql 64.59% <78.57%> (?)
postgres 64.67% <78.57%> (?)
presto 41.52% <35.71%> (?)
python 66.46% <78.57%> (?)
sqlite 64.26% <78.57%> (?)
superset-extensions-cli 96.49% <ø> (?)
unit 100.00% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@villebro villebro force-pushed the villebro/gtf-fixes-1 branch 2 times, most recently from a131c33 to 8effcd0 Compare February 10, 2026 00:38
@bito-code-review
Copy link
Contributor

bito-code-review bot commented Feb 10, 2026

Code Review Agent Run #98929d

Actionable Suggestions - 0
Review Details
  • Files reviewed - 8 · Commit Range: 8effcd0..8effcd0
    • superset-core/src/superset_core/api/tasks.py
    • superset/daos/tasks.py
    • superset/models/tasks.py
    • superset/tasks/manager.py
    • superset/tasks/schemas.py
    • tests/integration_tests/tasks/test_sync_join_wait.py
    • tests/unit_tests/daos/test_tasks.py
    • tests/unit_tests/tasks/test_manager.py
  • Files skipped - 1
    • docs/developer_portal/extensions/tasks.md - Reason: Filter setting
  • Tools
    • Whispers (Secret Scanner) - ✔︎ Successful
    • Detect-secrets (Secret Scanner) - ✔︎ Successful
    • MyPy (Static Code Analysis) - ✔︎ Successful
    • Astral Ruff (Static Code Analysis) - ✔︎ Successful

Bito Usage Guide

Commands

Type the following command in the pull request comment and save the comment.

  • /review - Manually triggers a full AI review.

  • /pause - Pauses automatic reviews on this pull request.

  • /resume - Resumes automatic reviews.

  • /resolve - Marks all Bito-posted review comments as resolved.

  • /abort - Cancels all in-progress reviews.

Refer to the documentation for additional commands.

Configuration

This repository uses Superset You can customize the agent settings here or contact your Bito workspace admin at evan@preset.io.

Documentation & Help

AI Code Review powered by Bito Logo

@villebro villebro force-pushed the villebro/gtf-fixes-1 branch from 8effcd0 to e6fee4e Compare February 10, 2026 03:12
Copy link
Contributor

@bito-code-review bito-code-review bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review Agent Run #8b1382

Actionable Suggestions - 1
  • superset/tasks/schemas.py - 1
Review Details
  • Files reviewed - 8 · Commit Range: e6fee4e..c880fb7
    • superset-core/src/superset_core/api/tasks.py
    • superset/daos/tasks.py
    • superset/models/tasks.py
    • superset/tasks/manager.py
    • superset/tasks/schemas.py
    • tests/integration_tests/tasks/test_sync_join_wait.py
    • tests/unit_tests/daos/test_tasks.py
    • tests/unit_tests/tasks/test_manager.py
  • Files skipped - 1
    • docs/developer_portal/extensions/tasks.md - Reason: Filter setting
  • Tools
    • Whispers (Secret Scanner) - ✔︎ Successful
    • Detect-secrets (Secret Scanner) - ✔︎ Successful
    • MyPy (Static Code Analysis) - ✔︎ Successful
    • Astral Ruff (Static Code Analysis) - ✔︎ Successful

Bito Usage Guide

Commands

Type the following command in the pull request comment and save the comment.

  • /review - Manually triggers a full AI review.

  • /pause - Pauses automatic reviews on this pull request.

  • /resume - Resumes automatic reviews.

  • /resolve - Marks all Bito-posted review comments as resolved.

  • /abort - Cancels all in-progress reviews.

Refer to the documentation for additional commands.

Configuration

This repository uses Superset You can customize the agent settings here or contact your Bito workspace admin at evan@preset.io.

Documentation & Help

AI Code Review powered by Bito Logo

Comment on lines +28 to +30
dedup_key_description = (
"The hashed deduplication key used internally for task deduplication"
)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Inaccurate API field description

The dedup_key description claims it's always 'hashed', but for finished tasks, it's set to the task's UUID string. This could mislead API consumers about the field's format.

Code suggestion
Check the AI-generated fix before applying
Suggested change
dedup_key_description = (
"The hashed deduplication key used internally for task deduplication"
)
dedup_key_description = (
"The deduplication key used internally for task deduplication"
)

Code Review Run #8b1382


Should Bito avoid suggestions like this for future reviews? (Manage Rules)

  • Yes, avoid them

@villebro villebro merged commit 0f1278f into apache:master Feb 10, 2026
70 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

change:backend Requires changing the backend doc Namespace | Anything related to documentation size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants