Schema error: No such field: deletionVector

[adzeeman]

Hi team,

I'm using DuckDB version: v1.0.0 1f98600c2c

This is the query I run:

CREATE SECRET (
      TYPE S3,
      PROVIDER CREDENTIAL_CHAIN
  );
SELECT * FROM delta_scan('s3://private-bucket/folder/');

Exception:

IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table: 's3://private-bucket/folder/''): Hit error: 2 (ArrowError) with message (Schema error: No such field: deletionVector)

The Delta table content was created using the Flink Delta connector, which uses Delta standalone.

Using Spark, I'm able to query the Delta table.

I tested the query with Delta tables created with other connectors, and they worked fine. Perhaps this is a delta-rs issue.

[adzeeman]

I'm closing this issues as I've had trouble re-creating it.

[samansmink]

Thanks @adzeeman I know about this issue, see delta-io/delta-kernel-rs#261.

I have this on my radar, while it might be partially fixed currently, I will need to do some proper testing. If you run into it again please don't hesitate to reopen!