Skip to content

✨ Destination DuckDB: upgrade to DuckDB v1.4.2 - #70221

Open
Elena Felder (elefeint) wants to merge 7 commits into
airbytehq:masterfrom
elefeint:upgrade-duckdb-1.4.2
Open

✨ Destination DuckDB: upgrade to DuckDB v1.4.2#70221
Elena Felder (elefeint) wants to merge 7 commits into
airbytehq:masterfrom
elefeint:upgrade-duckdb-1.4.2

Conversation

@elefeint

@elefeint Elena Felder (elefeint) commented Nov 26, 2025

Copy link
Copy Markdown
Contributor

What

  • Update DuckDB connector to DuckDB v1.4.2
  • Update MotherDuck connector to DuckDB v1.4.2 and SQLAlchemy driver (duckdb-engine) 0.17.0
  • Note that DuckDB 1.4.x requires Python 3.9, up from the EOL Python 3.8

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

@github-actions

github-actions Bot commented Nov 26, 2025

Copy link
Copy Markdown
Contributor

👋 Welcome to Airbyte!

Thank you for your contribution from elefeint/airbyte! We're excited to have you in the Airbyte community.

Helpful Resources

PR Slash Commands

As needed or by request, Airbyte Maintainers can execute the following slash commands on your PR:

  • /format-fix - Fixes most formatting issues.
  • /bump-version - Bumps connector versions.
  • /run-connector-tests - Runs connector tests.
  • /run-cat-tests - Runs CAT tests.
  • /run-live-tests - Runs live tests for the modified connector(s).
  • /run-regression-tests - Runs regression tests for the modified connector(s).
  • /build-connector-images - Builds and publishes a pre-release docker image for the modified connector(s).
  • /publish-connectors-prerelease - Publishes pre-release connector builds (tagged as {version}-dev.{git-sha}) for all modified connectors in the PR.

If you have any questions, feel free to ask in the PR comments or join our Slack community.

Tips for Working with CI

  1. Pre-Release Checks. Please pay attention to these, as they contain standard checks on the metadata.yaml file, docs requirements, etc. If you need help resolving a pre-release check, please ask a maintainer.
    • Note: If you are creating a new connector, please be sure to replace the default logo.svg file with a suitable icon.
  2. Connector CI Tests. Some failures here may be expected if your tests require credentials. Please review these results to ensure (1) unit tests are passing, if applicable, and (2) integration tests pass to the degree possible and expected.
  3. (Optional.) BYO Connector Credentials for tests in your fork. You can optionally set up your fork with BYO credentials for your connector. This can significantly speed up your review, ensuring your changes are fully tested before the maintainers begin their review.

📝 Edit this welcome message.

@aaronsteers

This comment has been minimized.

Sign in to view
@aaronsteers

This comment was marked as outdated.

Sign in to view
@aaronsteers

Aaron ("AJ") Steers (aaronsteers) commented Dec 1, 2025 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Member

/run-connector-tests

Connector CI Tests Started

These tests will leverage Airbyte's integration test credentials.

Check job output.
✅ Connector CI Tests job completed successfully. See logs for details.

Copilot AI reviewed Dec 1, 2025
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR upgrades the DuckDB connector to version 1.4.2 and the MotherDuck connector to DuckDB v1.4.2 with duckdb-engine v0.17.0. The upgrade also includes updating the minimum Python version from 3.8 to 3.9 for the DuckDB connector.

Key Changes:

  • DuckDB library upgraded from 1.1.2/1.2.1 to 1.4.2 across both connectors
  • MotherDuck's duckdb-engine dependency upgraded from 0.13.4 to 0.17.0
  • Minimum Python version for destination-duckdb updated from 3.8 to 3.9

Reviewed changes

Copilot reviewed 7 out of 9 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
docs/integrations/destinations/motherduck.md Added changelog entry for MotherDuck v0.2.0 release
docs/integrations/destinations/duckdb.md Added changelog entry for DuckDB v0.6.0 release
airbyte-integrations/connectors/destination-motherduck/pyproject.toml Updated version to 0.2.0, upgraded duckdb to 1.4.2 and duckdb-engine to 0.17.0
airbyte-integrations/connectors/destination-motherduck/metadata.yaml Updated Docker image tag to 0.2.0
airbyte-integrations/connectors/destination-duckdb/pyproject.toml Updated version to 0.6.0, upgraded duckdb to 1.4.2, updated Python requirement to 3.9+, upgraded ruff to 0.7.1
airbyte-integrations/connectors/destination-duckdb/metadata.yaml Updated Docker image tag to 0.6.0
airbyte-integrations/connectors/destination-duckdb/destination_duckdb/init.py Added blank line for formatting

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docs/integrations/destinations/motherduck.md Outdated
Comment thread docs/integrations/destinations/duckdb.md Outdated
aaronsteers
Aaron ("AJ") Steers (aaronsteers) reviewed Dec 1, 2025
View reviewed changes
Comment thread docs/integrations/destinations/motherduck.md Outdated
@aaronsteers

This comment was marked as outdated.

Sign in to view
@DanyloGL Danylo Jablonski (DanyloGL) moved this from New PRs to Waiting Eng Team in 🧑‍🏭 Community Pull Requests Dec 2, 2025
Merged
1 task
@aaronsteers

Aaron ("AJ") Steers (aaronsteers) commented Dec 30, 2025 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Member

/run-connector-tests

Connector CI Tests Started

These tests will leverage Airbyte's integration test credentials.

Check job output.
❌ Connector CI Tests job failed. Please check the logs for details.

@devin-ai-integration

This comment was marked as off-topic.

Sign in to view
@aaronsteers

Aaron ("AJ") Steers (aaronsteers) commented Dec 30, 2025 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Member

/run-connector-tests

Connector CI Tests Started

These tests will leverage Airbyte's integration test credentials.

Check job output.
❌ Connector CI Tests job failed. Please check the logs for details.

This was referenced Dec 31, 2025
Merged
Closed
devin-ai-integration Bot added a commit that referenced this pull request Mar 31, 2026
@devin-ai-integration bot_apk
docs(destination-motherduck): improve documentation and fix changelog…
2172b84 
… dates

- Rewrite overview to accurately describe MotherDuck as the primary destination
- Add prerequisites section with account and token requirements
- Add step-by-step setup guide with FieldAnchor annotations
- Document schema configuration option
- Add known limitations section (case-insensitive column normalization)
- Move output schema and namespace sections to top level
- Remove misleading filesystem performance note
- Fix changelog dates: v0.2.2 (2026-03-17), v0.2.1 (2026-01-29), v0.2.0 (2026-01-06)
- Fix v0.2.0 PR link: #70221 (still open) -> #71063 (actually merged)

Co-Authored-By: bot_apk <apk@cognition.ai>
@devin-ai-integration devin-ai-integration Bot mentioned this pull request Mar 31, 2026
Closed
@devin-ai-integration devin-ai-integration Bot mentioned this pull request Jul 14, 2026
Merged
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@aaronsteers Aaron ("AJ") Steers (aaronsteers) aaronsteers left review comments
Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

community connectors/destination/duckdb connectors/destination/motherduck

Projects

🧑‍🏭 Community Pull Requests
Status: Waiting Eng Team

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@elefeint @aaronsteers @octavia-squidington-iii @DanyloGL