Skip to content

chore(destination-duckdb, destination-motherduck): upgrade DuckDB to v1.4.2 with base image fix - #71083

Closed
Aaron ("AJ") Steers (aaronsteers) wants to merge 7 commits into
masterfrom
devin/1735759945-duckdb-1.4.2-upgrade
Closed

chore(destination-duckdb, destination-motherduck): upgrade DuckDB to v1.4.2 with base image fix#71083
Aaron ("AJ") Steers (aaronsteers) wants to merge 7 commits into
masterfrom
devin/1735759945-duckdb-1.4.2-upgrade

Conversation

@aaronsteers

Copy link
Copy Markdown
Member

This PR is built on top of the contributor's work in:


What

Upgrades DuckDB to v1.4.2 for both destination-duckdb and destination-motherduck connectors, and fixes a CI failure in destination-duckdb container tests.

Root cause of CI failure: The old base image (python-connector-base:2.0.0) doesn't have the airbyte user in /etc/passwd, causing Docker to fail with:

docker: Error response from daemon: unable to find user airbyte: no matching entries in passwd file.

How

destination-duckdb:

  • Upgraded base image from python-connector-base:2.0.0 to 4.0.0 (fixes missing airbyte user)
  • Updated Python requirement to >=3.10 for PyAirbyte compatibility
  • Upgraded DuckDB from 1.2.1 to 1.4.2
  • Version bump: 0.5.1 → 0.6.0

destination-motherduck:

  • Upgraded DuckDB from 1.1.2 to 1.4.2
  • Upgraded duckdb-engine from 0.13.4 to 0.17.0
  • Version bump: 0.1.26 → 0.2.0

Review guide

  1. metadata.yaml - Base image SHA change for destination-duckdb
  2. pyproject.toml files - Version constraints and dependency updates
  3. poetry.lock files - Auto-regenerated dependency resolution
  4. docs/ - Changelog entries

User Impact

Users get access to DuckDB v1.4.2 features and improvements. No breaking changes expected.

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Link to Devin run: https://app.devin.ai/sessions/555cd7ebdc49448b8258f17d554f7414
Requested by: AJ Steers (Aaron ("AJ") Steers (@aaronsteers))

…thon 3.11)

The previous base image (python-connector-base:2.0.0) does not have the 'airbyte' user
in /etc/passwd, causing Docker to fail with 'unable to find user airbyte' error.

Changes:
- Update baseImage from 2.0.0 to 4.0.0 in metadata.yaml
- Update Python version from >=3.9 to >=3.11 in pyproject.toml
- Regenerate poetry.lock for Python 3.11 compatibility

Co-Authored-By: AJ Steers <aj@airbyte.io>
…irbyte compatibility

Co-Authored-By: AJ Steers <aj@airbyte.io>
@devin-ai-integration

Copy link
Copy Markdown
Contributor
Original prompt from AJ Steers
@Devin - Investigate this CI failure: <https://github.com/airbytehq/airbyte/actions/runs/19840138859/job/56846708941>

Does the container tests step not properly handle destinations? Or is something else going on?
Thread URL: https://airbytehq-team.slack.com/archives/D089P0UPVT4/p1767136855817929

@devin-ai-integration

Copy link
Copy Markdown
Contributor

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@github-actions

github-actions Bot commented Jan 1, 2026

Copy link
Copy Markdown
Contributor

👋 Greetings, Airbyte Team Member!

Here are some helpful tips and reminders for your convenience.

Helpful Resources

PR Slash Commands

Airbyte Maintainers (that's you!) can execute the following slash commands on your PR:

  • /format-fix - Fixes most formatting issues.
  • /bump-version - Bumps connector versions.
    • You can specify a custom changelog by passing changelog. Example: /bump-version changelog="My cool update"
    • Leaving the changelog arg blank will auto-populate the changelog from the PR title.
  • /bump-progressive-rollout-version - Bumps connector version with an RC suffix for progressive rollouts.
    • Creates a release candidate version (e.g., 2.16.10-rc.1) with enableProgressiveRollout: true
    • Example: /bump-progressive-rollout-version changelog="Add new feature for progressive rollout"
  • /run-cat-tests - Runs legacy CAT tests (Connector Acceptance Tests)
  • /run-regression-tests - Runs regression tests for the modified connector(s).
  • /build-connector-images - Builds and publishes a pre-release docker image for the modified connector(s).
  • /publish-connectors-prerelease - Publishes pre-release connector builds (tagged as {version}-preview.{git-sha}) for all modified connectors in the PR.
  • Connector release lifecycle (AI-powered):
    • /ai-prove-fix - Runs prerelease readiness checks, including testing against customer connections.
    • /ai-canary-prerelease - Rolls out prerelease to 5-10 connections for canary testing.
    • /ai-release-watch - Monitors rollout post-release and tracks sync success rates.
  • JVM connectors:
    • /update-connector-cdk-version connector=<CONNECTOR_NAME> - Updates the specified connector to the latest CDK version.
      Example: /update-connector-cdk-version connector=destination-bigquery
    • /bump-bulk-cdk-version bump=patch changelog='foo' - Bump the Bulk CDK's version. bump can be major/minor/patch.
  • Python connectors:
    • /poe connector source-example lock - Run the Poe lock task on the source-example connector, committing the results back to the branch.
    • /poe source example lock - Alias for /poe connector source-example lock.
    • /poe source example use-cdk-branch my/branch - Pin the source-example CDK reference to the branch name specified.
    • /poe source example use-cdk-latest - Update the source-example CDK dependency to the latest available version.

📝 Edit this welcome message.

@github-actions

github-actions Bot commented Jan 1, 2026

Copy link
Copy Markdown
Contributor

destination-duckdb Connector Test Results

13 tests   12 ✅  3s ⏱️
 2 suites   1 💤
 2 files     0 ❌

Results for commit e6f581e.

@github-actions

github-actions Bot commented Jan 1, 2026

Copy link
Copy Markdown
Contributor

destination-motherduck Connector Test Results

50 tests   48 ✅  18s ⏱️
 2 suites   2 💤
 2 files     0 ❌

Results for commit e6f581e.

@github-actions

github-actions Bot commented Jan 1, 2026

Copy link
Copy Markdown
Contributor

Deploy preview for airbyte-docs ready!

✅ Preview
https://airbyte-docs-gtkeztmi9-airbyte-growth.vercel.app

Built with commit e6f581e.
This pull request is being automatically deployed with vercel-action

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Closing as duplicate. Please see #71063 for the correct PR.

@devin-ai-integration
devin-ai-integration Bot deleted the devin/1735759945-duckdb-1.4.2-upgrade branch January 1, 2026 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants