Skip to content

v0.26.1

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 28 Aug 07:58
· 24 commits to main since this release

Added

  • pw.Table.forget to remove old (in terms of event time) entries from the pipeline.
  • pw.Table.buffer, a stateful buffering operator that delays entries until time_column <= max(time_column) - threshold condition is met.
  • pw.Table.ignore_late to filter out old (in terms of event time) entries.
  • Rows batching for async UDFs. It can be enabled with max_batch_size parameter.

Changed

  • pw.io.subscribe and pw.io.python.write now work with async callbacks.
  • The diff column in tables automatically created by pw.io.postgres.write and pw.io.postgres.write_snapshot in replace and create_if_not_exists initialization modes now uses the smallint type.
  • optimize_transaction_log option has been removed from pw.io.deltalake.TableOptimizer.

Fixed

  • pw.io.postgres.write and pw.io.postgres.write_snapshot now respect the type optionality defined in the Pathway table schema when creating a new PostgreSQL table. This applies to the replace and create_if_not_exists initialization modes.