Add release notes for 0.279

[wanglinsong]

Missing Release Notes

Amit Dutta

• [native] Advance velox version. #18904 [native] Advance velox version. (Merged by: Amit Dutta)
• [native] Adding partial support for EquatableValueSet filter. #18841 [native] Adding partial support for EquatableValueSet filter. (Merged by: Amit Dutta)
• [native] Import native and hashjoin related changes. #18839 [native] Import native and hashjoin related changes. (Merged by: Amit Dutta)
• [native] Better error message when filter conversion is not supported. #18830 [native] Better error message when filter conversion is not supported. (Merged by: Amit Dutta)
• [native] Minor changes in PrestoTask. #18760 [native] Minor changes in PrestoTask. (Merged by: Amit Dutta)
• [native] Fix crash in Taskmanager getResults. #18751 [native] Fix crash in Taskmanager getResults. (Merged by: spershin)
• [native] Minor cosmetic change in prestotask. #18725 [native] Minor cosmetic change in prestotask. (Merged by: Amit Dutta)
• [native] Use velox exception instead of std exception. #18641 [native] Use velox exception instead of std exception. (Merged by: Amit Dutta)
• [native] Allow overriding file system registration. #18562 [native] Allow overriding file system registration. (Merged by: Amit Dutta)

Avinash Jain

• Adding support of MAP_TOP_N_KEYS to Presto #18625 Adding support of MAP_TOP_N_KEYS to Presto (Merged by: Sreeni Viswanadha)

Eduard Tudenhoefner

• Upgrade Iceberg from 1.0.0 to 1.1.0 #18709 Upgrade Iceberg from 1.0.0 to 1.1.0 (Merged by: Chunxu Tang)
• Re-enable Nessie namespace/table visibility tests #18124 Re-enable Nessie namespace/table visibility tests (Merged by: Chunxu Tang)

Ge Gao

• [native] Table writer 2: Add Presto write protocols #18377 [native] Table writer 2: Add Presto write protocols (Merged by: Ge Gao)

George Wang

• Improve call performance for sync_partition_metadata utility #18384 Improve call performance for sync_partition_metadata utility (Merged by: Ying)
• Enable Estimated Stats on Query Plan for Instrumentation Monitoring #18682 Enable Estimated Stats on Query Plan for Instrumentation Monitoring (Merged by: Ying)

Guy Moore

• Prepare for next development iteration - 0.279-SNAPSHOT #18552 Prepare for next development iteration - 0.279-SNAPSHOT (Merged by: Guy ☀️ Moore)

Jon Janzen

• [native] Fix gitattributes #18686 [native] Fix gitattributes (Merged by: Michael Shang)

Karteek Murthy Samba Murthy

• Advance Velox #18827 Advance Velox (Merged by: Aditi Pandit)
• Decimal arithmetic and logical functions e2e tests #18320 Decimal arithmetic and logical functions e2e tests (Merged by: Aditi Pandit)

Linkiewicz, Milosz

• [native] PrestoCpp build from source pipeline #18572 [native] PrestoCpp build from source pipeline (Merged by: Krishna Pai)

Linsong Wang

• [18366] Create a Jenkins pipeline to build and release artifacts #18483 [18366] Create a Jenkins pipeline to build and release artifacts (Merged by: Timothy Meehan)
• 240d0b8 Update stable release branch development version to 0.279.1-SNAPSHOT

Lyublena Antova

• Optimize const grouping keys #17642 Optimize const grouping keys (Merged by: Sreeni Viswanadha)

MJ Deng

• Fix BatchTaskUpdateRequest failures #18837 Fix BatchTaskUpdateRequest failures (Merged by: tanjialiang)
• Add NativeExecutionProcess and facilities #18681 Add NativeExecutionProcess and facilities (Merged by: tanjialiang)
• Add NativeExecutionShuffleManager for presto spark native execution #18623 Add NativeExecutionShuffleManager for presto spark native execution (Merged by: ARUNACHALAM THIRUPATHI)

Reetika Agrawal

• Add support for UUID in PostgreSQL connector #16875 Add support for UUID in PostgreSQL connector (Merged by: Timothy Meehan)

Vivek

• Transformations of Existential Subqueries using Early-out Joins #18381 Transformations of Existential Subqueries using Early-out Joins (Merged by: Rebecca Schlussel)

ajantha-bhat

• Bump Nessie from 0.43.0 to 0.44.0 #18710 Bump Nessie from 0.43.0 to 0.44.0 (Merged by: Chunxu Tang)

pen4

• fix(sec): upgrade com.google.protobuf:protobuf-java to 3.21.7 #18763 fix(sec): upgrade com.google.protobuf:protobuf-java to 3.21.7 (Merged by: Rebecca Schlussel)

Extracted Release Notes

• Add support for user/password auth - Elasticsearch #16524 (Author: v-jizhang): Add support for user/password auth - Elasticsearch
  • Add support for Elasticsearch user and password authentication. :issue:15909.
• Add REMOVE_NULLS function for arrays #18460 (Author: Sacha Viscaino): Add REMOVE_NULLS function for arrays
  • Add :func:remove_nulls function to remove null elements from an array.
• Remove redundant distinct over group by #18512 (Author: Feilong Liu): Remove redundant distinct over group by
  • Add an optimization which removes redundant distinct if the output is already distinct after a group by operation. The optimization is controlled by session property remove_redundant_distinct_aggregation which is default to false.
• Update Iceberg from 0.14.1 to 1.0.0 #18525 (Author: Eduard Tudenhoefner): Update Iceberg from 0.14.1 to 1.0.0
  • Update Iceberg from 0.14.1 to 1.0.0.
• integrate and implement open telemetry tracing #18534 (Author: Alex Chen): integrate and implement open telemetry tracing
  • Introduced a new plugin type for tracing. The legacy tracer module can be replaced by the new plugin for loading customized tracing infrastructure.
  • Introduced a new Open Telemetry tracer implementation. Users are able to enable the tracer by installing the presto-open-telemetry plugin and updating the application configuration (config.properties). Open Telemetry tracer can take in propagated context (only B3 specification currently supported) and baggage (W3C specification) headers, if provided, and inject into new traces / spans. Traces can be exported to any specified backend with the OTEL_EXPORTER_OTLP_ENDPOINT environment variable.
• Fix weighted fair scheduling in disagg coordinator #18543 (Author: Swapnil Tailor): Fix weighted fair scheduling in disagg coordinator
  • Fix for weighted fair scheduling in disaggregated coordinator.
• Add ARRAY_MIN_BY, ARRAY_MAX_BY functions #18555 (Author: Sacha Viscaino): Add ARRAY_MIN_BY, ARRAY_MAX_BY functions
  • Add functions :func:array_min_by, :func:array_max_by, to find the smallest or largest element of an array when applying a custom measuring function.
• Create QueryPreparer interface #18561 (Author: Rohit Jain): Create QueryPreparer interface
  • Add CONTROL as a new QueryType. The CONTROL queryType represents statements of session control and transaction control types.
• Support STRPOS pushdown to Pinot; Fix missing configuration property pinot.query-options error #18566 (Author: Nizar Hejazi): Support STRPOS pushdown to Pinot; Fix missing configuration property pinot.query-options error
  • Add pushdown support for STRPOS function.
• Generalize existing SQL UDF functions to all types #18587 (Author: Sacha Viscaino): Generalize existing SQL UDF functions to all types
  • Extend :func:array_frequency, :func:array_duplicates, :func:array_has_duplicates, :func:array_intersect(array(array(E)) to accept any type as input instead of only varchar/double.
• Fix Disaggregated Coordinator Weighted Scheduling #18595 (Author: Swapnil Tailor): Fix Disaggregated Coordinator Weighted Scheduling
  • Fix weighted scheduling for disaggregated coordinator.
• Adding support of map_top_n_values to Presto #18607 (Author: Avinash Jain): Adding support of map_top_n_values to Presto
  • Add :func:map_top_n_values to return top N values of the provided map. An optional lambda comparator can also be passed as parameter for custom sorting of the values.
• Fix MIN(x, n) and MAX(x, n) returning NULL on window aggregations #18615 (Author: Sacha Viscaino): Fix MIN(x, n) and MAX(x, n) returning NULL on window aggregations
  • Fix max(x, n) and min(x, n) returning NULL on window aggregations.
• Adding support for ARRAY_SORT_DESC to Presto #18660 (Author: Avinash Jain): Adding support for ARRAY_SORT_DESC to Presto
  • Add :func:array_sort_desc function to sort an array in the descending order.
• Adding support of MAP_REMOVE_NULL_VALUES for Presto #18675 (Author: Avinash Jain): Adding support of MAP_REMOVE_NULL_VALUES for Presto
  • Add :func:map_remove_null_values to remove all the entries where the value is null from the given map.
• Move ViewDefinition to presto-analyzer #18680 (Author: Rohit Jain): Move ViewDefinition to presto-analyzer
  • Rename ConnectorMaterializedViewDefinition to MaterializedViewDefinition.
• Adding support of MAP_TOP_N for Presto #18698 (Author: Avinash Jain): Adding support of MAP_TOP_N for Presto
  • Add :func:map_top_n to truncates map items. Keeps only the top N elements by value.
• Fix wrong results in MetadataQueryOptimizer with subfield filters #18704 (Author: Rebecca Schlussel): Fix wrong results in MetadataQueryOptimizer with subfield filters
  • Fix a bug when optimize_metadata_queries was set to true where queries with aggregations on partition columns and filters on row subfields could return wrong results.
• Add auto-tuning of max executor and hash partition #18716 (Author: Pratyush Verma): Add auto-tuning of max executor and hash partition
  • Add property spark_executor_allocation_strategy_enabled to auto-tune spark max executor count (spark.dynamicAllocation.maxExecutors) based on input data. Only required if spark_resource_allocation_strategy_enabled is not already enabled.
  • Add property spark_hash_partition_count_allocation_strategy_enabled to auto-tune hash partition count (hash_partition_count) based on input data. Only required if spark_resource_allocation_strategy_enabled is not already enabled.
• Fix Disagg Coordinator task limit enforcement #18732 (Author: Swapnil Tailor): Fix Disagg Coordinator task limit enforcement
  • Fix disagg coordinator task limit enforcement.
• Remove unused code #18749 (Author: Sreeni Viswanadha): Remove unused code
  • Removed two unused session params - hash_based_distinct_limit_enabled and hash_based_distinct_limit_threshold and the corresponding implementation in favor of the quick_distinct_limit_enabled feature.
• Upgrade Delta Standalone to 0.6.0 #18773 (Author: dnskr): Upgrade Delta Standalone to 0.6.0
  • Upgrade Delta Standalone to 0.6.0.
• Disable S3 Select pushdown when the query does not filter data #18778 (Author: dnnanuti): Disable S3 Select pushdown when the query does not filter data
  • Disable S3 Select pushdown when the query does not have a predicate or projection.
• Fix bug in CombineApproxPercentileFunctions with duplicate aggregation expressions #18889 (Author: Feilong Liu): Fix bug in CombineApproxPercentileFunctions with duplicate aggregation expressions
  • Fix bug in CombineApproxPercentileFunctions optimization. It fix the bug where the CombineApproxPercentileFunctions optimization rule fails when there are duplicate aggregation expressions to be optimized.

All Commits

• 240d0b8 Update stable release branch development version to 0.279.1-SNAPSHOT (Linsong Wang)
• 820b4eb Add test dependency on presto-common to presto-benchto-benchmarks (Vivek)
• 2a7dd51 Add Hive S3 tests for comma and pipe delimited CSVs (dnnanuti)
• 8ab844c Fix bug in TypedSet.addAndGetPosition when adding a new element (Sreeni Viswanadha)
• 0bc762b [native] Advance velox version. (Amit Dutta)
• 4fdd16e Add a metastore interface to control add partition commit batch size (George Wang)
• bb88317 Bypass file path check for sync partition (George Wang)
• 13109ed Use correct API to get partition names in batch for sync partition call (George Wang)
• 3cfe62f Adding support of MAP_TOP_N for Presto (Avinash Jain)
• e7be56a Document public methods of SqlQueryExecution (Anant Aneja)
• a1a9299 Add AdaptivePlanOptimizers class (Rebecca Schlussel)
• ab3bdf1 Add support for calculating RemoteSourceNode stats (Rebecca Schlussel)
• 48c1dbf Better support stats that only contain total size (Rebecca Schlussel)
• 791ff32 Remove crux analyzer artifacts (Rohit Jain)
• ad8660b Add analyzer provider plugin (Rohit Jain)
• 001dbd5 Remove ParsingOptions from AnalyzerOptions (Rohit Jain)
• f92c65f Cancel previous workflow runs for github actions (Josh Soref)
• e349c4a Fix bug in CombineApproxPercentileFunctions (Feilong Liu)
• 974bbba Refactor S3 tests (dnnanuti)
• e0f637f [native] Refactor shuffle reader to deal with only 1 partition (tanjialiang)
• 1c3e7c8 Advance Velox version (xiaoxmeng)
• 94c1d72 Add Graphviz query plan monitoring for instrumentation (George Wang)
• a67150e Add estimates to json format of the plan (George Wang)
• f817946 Add estimates to graphviz of the plan (George Wang)
• 4250b5c Add units for Alluxio metrics (Zac)
• 78f7a7c [native] Adding partial support for EquatableValueSet filter. (Amit Dutta)
• 62945aa [native]Deprecate total memory query limit as velox doesn't differentiate user and system memory (xiaoxmeng)
• cc5c323 [native] Import native and hashjoin related changes. (Amit Dutta)
• 1b2f463 Fix batch query plan convertor for non shuffle plan (MJ Deng)
• 72b8852 Fix BatchTaskUpdate request URI matching order (MJ Deng)
• f00d078 Add sdruzkin as CODEOWNER for presto-orc (Rebecca Schlussel)
• 181ec81 Replace sun.reflect...NotImplementedException with UnsupportedOperationException (Sergii Druzkin)
• 3839ee0 [native] Move shuffle name to shuffle factory (tanjialiang)
• e258434 [native] Remove const specifier from hasNext in ShuffleReader (tanjialiang)
• bb3794d Fix storage descriptor test cases (Pratyaksh Sharma)
• db015ec [native] Update code that sets up the task spill directory. (Sergey Pershin)
• 017d65c Fix leaked query count reporting in the disagg coordinators codepath (Devesh Agrawal)
• 15788ac Fix bug in CBO stats (Pranjal Shankhdhar)
• c4401f6 [native] Better error message when filter conversion is not supported. (Amit Dutta)
• cd41eb1 Advance Velox (Karteek Murthy Samba Murthy)
• 1c4822c Add support for user/password auth (v-jizhang)
• cb569f1 Use assertj for query assertions (v-jizhang)
• f6a0a03 Add a constructor to QueryAssertions (v-jizhang)
• 13ca62f Add instructions on how to start Elasticsearch (v-jizhang)
• 881a616 Migrate Elasticsearch tests to testcontainers (v-jizhang)
• 03938b4 Add support for UUID in PostgreSQL connector (Reetika Agrawal)
• f0e39cb Fix catalog config resource lost on hudi mor read (suheng)
• 05688c7 update com.google.protobuf:protobuf-java 3.19.2 to 3.21.7 (pen4)
• ddca5d1 Add auto-tuning of max executor and hash partition (Pratyush Verma)
• 3b05e32 [velox] Generate Task spilling directory. (Sergey Pershin)
• 760a0ea Remove negative test cases (Karteek Murthy Samba Murthy)
• d572b09 Decimal arithmetic and logical functions e2e tests (Karteek Murthy Samba Murthy)
• 7555676 Add an optimizer for AQE for swapping join sides (Rebecca Schlussel)
• 1582da0 Upgrade Delta Standalone to 0.6.0 (dnskr)
• a7f0666 Advance velox version with memory back out (xiaoxmeng)
• 2d8839b Add a session property enabling DWRF flat map writer (Sergii Druzkin)
• 5a7e325 Add DDL support for Alpha format (Sergii Druzkin)
• 07b00d2 Fix bug in test TestCursorProcessorCompiler (wangd)
• 3984146 Table writer 3: Adapt to renaming of FileSink (Ge Gao)
• 28ca22b Remove unused classes (Vivek)
• 367cf03 [native] Advance Velox version. (Sergey Pershin)
• dd5ae3b Introduce PrestoSparkProperties for PrestoSparkRunner (Jaromir Vanek)
• 9c5970d Adding support of MAP_REMOVE_NULL_VALUES for Presto (Avinash Jain)
• 6af6af6 Abstract the NativeExecutionProcessFactory to be a pluggable interface (MJ Deng)
• d1a0bce Add TypedSet.addAndGetPosition for use in MultiMapFromEntries (Sreeni Viswanadha)
• 57a3252 [native] Temporarily disable the spilling test in TaskManagerTest (Sergey Pershin)
• da9f260 Disable S3 Select pushdown when the query does not filter data (dnnanuti)
• 40d84a4 Optimize plan hashing in case of union/join nodes (Pranjal Shankhdhar)
• 5a31a49 [native] Update Velox version (tanjialiang)
• 800baa5 [native] Add virtual destructor for ShuffleInterfaceFactory (tanjialiang)
• 95cc942 [native] Remove readyForRead() as it is not used (tanjialiang)
• 0725d5b Resolve "Unknown file extension" license-maven-plugin warnings (dnskr)
• 17acbeb [native] Split ShuffleInterface to ShuffleReadInterface and ShuffleWriteInterface (tanjialiang)
• 9e010a7 Optimize mapToMapCast for common cases (Sreeni Viswanadha)
• 717f74b Optimize TypeSet contains/add pattern (Arunachalam Thirupathi)
• 313b7a0 [native] Fix shuffle code for buck build and cleanup (tanjialiang)
• 2744f0e Fix Disagg Coordinator task limit enforcement (Swapnil Tailor)
• 8ba44be Minify the router UI (JoshuaTang)
• d17e99e Add shangxinli as CODEOWNER for Parquet (Timothy Meehan)
• b3d7cf4 [native] Update velox version (tanjialiang)
• f760a0a [native] Move construction of ShuffleInterface for write in operator (tanjialiang)
• 1abb2fc [native] Add batch task update http endpoint (tanjialiang)
• b111eaa [native] Add batch read exchange source creation (tanjialiang)
• 7d22bc0 [native] Add batch task creation logic for shuffle write (tanjialiang)
• 0dabcc7 [native] Add shuffle write path plan conversion in PrestoToVeloxQueryPlan (tanjialiang)
• 670ae5b [native] Shuffle related entities should have shared ownership to ShuffleInterface (tanjialiang)
• 51c51c4 [native] Change PartitionAndSerialize to have pass in partition function (tanjialiang)
• 73ad442 [native] Add LocalShuffleDeserializer (tanjialiang)
• 0271efd [native] Add shuffle interface registration framework (tanjialiang)
• 3d2ac5a [native] Minor refactor on TestingPersistentShuffle (tanjialiang)
• ad30c8f Revert "Fix ROUND() returning incorrect results for edge cases" (Jingmei Huang)
• cf349fb Remove duplicate MISSING_TABLE errorcode (Rohit Jain)
• 524df39 [native] Use "experimental.spiller-spill-path" config property. (Sergey Pershin)
• 9b74150 Create s3select package for presto-hive (dnnanuti)
• 2d04644 Adding Glue catalog configuration in Iceberg document (Reetika Agrawal)
• b8357f4 [native] Fix 'spilling' Runtime Metrics. (Sergey Pershin)
• 128df83 Add types method in metadataResolver (Rohit Jain)
• a586c90 [native] Minor changes in PrestoTask. (Amit Dutta)
• b12080e Optimize copyPositions method in DictionaryBlock (Arunachalam Thirupathi)
• 1cb5fff Add dummy crux analyzer (Rohit Jain)
• b80831f [native] Fix crash in Taskmanager getResults. (Amit Dutta)
• c9482cd Upgrade Iceberg from 1.0.0 to 1.1.0 (Eduard Tudenhoefner)
• bc3f6ec Address bug in flushing broadcast table to temp storage (Arjun Gupta)
• d68a7ee [native] Advance velox version and update memory usage (xiaoxmeng)
• a032115 [native] some trivial code cleanup (xiaoxmeng)
• 48a7d5f Update the BatchTaskUpdateRequest structure to remove the ShuffleReadInfo field (MJ Deng)
• 97a6e44 Fix a typo in a json_parse example (Zac)
• 8860ea4 Integrate native process with NativeExecutionOperator (MJ Deng)
• 2c1d402 implement open telemetry tracing plugin (Alex Chen)
• d9c2c0a Remove unused code. (Sreeni Viswanadha)
• a39e7c9 Implement fragmented execution (singcha)
• ef40144 [native] Fix gitattributes (Jon Janzen)
• 2ad80f0 Update with velox memory management (xiaoxmeng)
• 35aa790 Refactor json file based function manager (Feilong Liu)
• 43e52ae Bump Nessie from 0.43.0 to 0.44.0 (ajantha-bhat)
• 1fedf48 Add MetadataResolver interface (Rohit Jain)
• fc97690 Support HBO for presto on spark (Pranjal Shankhdhar)
• 7f5f219 Use exact size when using history based statistics (Pranjal Shankhdhar)
• 20c06c3 Log when MetadataPlanOptimizer triggers (Rebecca Schlussel)
• 82441f5 Fix wrong results in MetadataQueryOptimizer with subfield filters (Rebecca Schlussel)
• bffedbb Bash common.sh memory_gb_preflight_check() added (Linkiewicz, Milosz)
• 225471d Folly build from source fix. (Linkiewicz, Milosz)
• 88b0d49 entrypoint.sh - defaults all required runtime parameters when no commandline flags provided nor config file mounted. (Linkiewicz, Milosz)
• bffd8c6 [native] PrestoCpp build from source pipeline (Linkiewicz, Milosz)
• eeb5a7d Add NativeExecutionProcess and facilities (MJ Deng)
• 558677e Re-enable Nessie namespace/table visibility tests (Eduard Tudenhoefner)
• b50a353 [native] Minor cosmetic change in prestotask. (Amit Dutta)
• 7aa8e2f [native] Add new query runtime metrics (spilling & # of drivers). (Sergey Pershin)
• fd4ad2a Upgrade alluxio to 2.9.0 (Hope Wang)
• bcf3060 Add name for prestor executors (xiaoxmeng)
• 20e6b25 Rename ConnectorMaterializedViewDefinition (Rohit Jain)
• bc898d1 Move ViewDefinition to presto-analyzer (Rohit Jain)
• 5a7e10d Add NativeExecutionShuffleManager for presto spark native execution (MJ Deng)
• f806a0e Fix last scheduling cycle run time metric (Swapnil Tailor)
• 3deb0b4 [native] Rename two Presto operators in operator stats. (Sergey Pershin)
• ac3e41e Add support for retrieving table by TableHandle (Arunachalam Thirupathi)
• c4cf3fa Move HiveTableHandle from presto-hive to presto-hive-metastore (Arunachalam Thirupathi)
• 2d0e5bc Add HiveTableHandle to HiveTableLayoutHandle (Arunachalam Thirupathi)
• a1175e3 Optimize slice function (Sreeni Viswanadha)
• 71b3911 Avoid footer stats when not reliable (abhiseksaikia)
• 3fc6273 [native] Fix license headers (tanjialiang)
• 31bb7b8 [native] Add comments to shuffle related codebase (tanjialiang)
• 374c776 Log rules triggered per query in iterative optimizer (Feilong Liu)
• d391a05 Fix Hudi queries from S3 table when using hive connector (Pratyaksh Sharma)
• 7c1c9a4 Update DROP Table example in Delta document (Reetika Agrawal)
• e126d8d Fix a typo in CBO doc (v-jizhang)
• ba08fac Adding support of MAP_TOP_N_VALUES to Presto (Avinash Jain)
• 6309d41 Add IterativePlanFragmenter (Rebecca Schlussel)
• 4ab3174 Add equals/hashcode for StatsAndCost and StageExecutionDescriptor (Rebecca Schlussel)
• ce413c8 Move common plan fragmenting code to common classes (Rebecca Schlussel)
• 88076b3 Extract public methods/classes for plan fragmenting (Rebecca Schlussel)
• 00e721a Extract GroupedExecutionTagger to a top level class (Rebecca Schlussel)
• 093b3b4 Refactor HiveTableLayoutHandle (Arunachalam Thirupathi)
• 02fec80 [native] Change PrestoExchangeSourceTest::waitForDeleteResults to wait longer (tanjialiang)
• e6d6445 Add Json file based function namespace manager (Feilong Liu)
• a90bc6e Add CPP UDF type (Feilong Liu)
• fc13d26 [native] Fix presto_protocol README headers (Deepak Majeti)
• 0fd614b [native] Include FBTHRIFT system path in CMakeList.txt (Ge Gao)
• ac56a5a [native] Improve presto_protocol README (Deepak Majeti)
• 05072ca Advance velox version and use consolidated memory pool (xiaoxmeng)
• 7d5fa52 [native] Add BatchTaskUpdateRequest to native execution protocol (tanjialiang)
• 5b1f2dd Transformations of Existential Subqueries using Early-out Joins (Vivek)
• d21bbc2 Add LogicalProperty canBeHomogenized that determines whether one set of intermediate plan expressions can be realized using another set (Vivek)
• c78a75a Add information about Presto native and Velox (Krishna Pai)
• c329c38 [native] Add Presto write protocols (Ge Gao)
• 19a9bb8 Adding support of ARRAY_SORT_DESC for Presto (Avinash Jain)
• 43a5fa0 Add revocable memory info in GCStatusMonitor logs (Swapnil Tailor)
• c9ebcd3 [native] Add support for TPC-H Connector Protocol Bindings (Deepak Majeti)
• 2f14947 Fix PullConstantsAboveGroupBy for empty input (Rebecca Schlussel)
• 9bcf89d [native] Add more semi- and anti-join e2e tests (Masha Basmanova)
• 8b9bc1a [native] Update Velox (Masha Basmanova)
• 13900cb Update velox version (tanjialiang)
• 30ed727 Support HiveFileSplit in presto_cpp (Arunachalam Thirupathi)
• 4ab6b4b Refactor HiveFileSplit to its own class (Arunachalam Thirupathi)
• 4fd6506 Update with new QueryCtx interface and advance Velox version (xiaoxmeng)
• d60aae2 [native] Replace JoinType::kLeftSemi with kLeftSemiFilter (Ge Gao)
• 919ce85 [native] Bring generated protocol code up-to-date with PrestoDB (tanjialiang)
• 28c7388 Add local shuffle implementation for shuffle read/write info (tanjialiang)
• 5a95ff6 Add BatchTaskUpdateRequest class for native execution (tanjialiang)
• 2552200 Add shuffle info interfaces for native execution mode (tanjialiang)
• 05fcfbf Adding support of MAP_TOP_N_KEYS to Presto (Avinash Jain)
• 87c43b2 Fix incorrectly set wall time (Anant Aneja)
• 352c8a2 [native] Use velox exception instead of std exception. (Amit Dutta)
• 79b2d04 [native] Use Release configuration instead of Debug for native-test. (Sergey Pershin)
• 339d1d7 Add window ranking function tests (Pramod)
• 63804c7 Add ARRAY_MIN_BY, ARRAY_MAX_BY functions (Sacha Viscaino)
• 8e66656 [native] Pass LocationHandle to HiveInsertTableHandle (Ge Gao)
• 4053ddc Fix MIN(x, n) and MAX(x, n) on window functions (Sacha Viscaino)
• 6ad58d8 Move constant grouping keys above the group by (Lyublena Antova)
• fb0c4dc Add native execution related properties to config classes (tanjialiang)
• 99d8b63 [native] Fix test native failure (Deepak Majeti)
• 47173ac Add logging for IterativeOptimizer (Feilong Liu)
• e2f5ad5 Add optimizer information collector for optimizer logging (Feilong Liu)
• c32f1b8 Change $0 to $BASH_SOURCE[0] (Miłosz Linkiewicz)
• f7d9d6d Fix to sourcing (Miłosz Linkiewicz)
• 10ee472 Source velox helper functions (Miłosz Linkiewicz)
• ccd4324 Use cmake_install from velox (Miłosz Linkiewicz)
• 9841ab8 Build shared libs (Miłosz Linkiewicz)
• 7a6b423 [native] Centos unified build and install process (Milosz Linkiewicz)
• 0e1fa6f [native] Add folly install job for script to work correctly (Milosz Linkiewicz)
• bad783d Fix bug in test TestFilteredAggregations (Feilong Liu)
• f6b4565 Put type translator back (James Sun)
• 40421f3 Add property builder and populator (tanjialiang)
• 208b60e Fix Disaggregated Coordinator Weighted Scheduling (Swapnil Tailor)
• ea8ea14 Support multi-coordinator while serving task info (Asjad Syed)
• 6f57e42 Add javadoc for query dispatch management (George Wang)
• 55e2523 Fix CI for next snapshot iteration PRs (Guy Moore)
• 96180d8 Expose Filter push down support (Arunachalam Thirupathi)
• cb986f6 Add retryExecutionStrategy in client tags (Arjun Gupta)
• a62173e Fetcher timeout should be at http level (tanjialiang)
• 456d5cf Support Domain Expressions for GlueHiveMetastore (Vivek)
• e52a7f1 Generalize existing SQL UDF functions to all types (Sacha Viscaino)
• 816187a Support STRPOS pushdown to Pinot; Fix missing configuration property pinot.query-options error (Nizar Hejazi)
• 6edfac9 Add javadoc for Presto query submission protocol (Vivek)
• e7a5eea Add TypeParameters to SqlInvokedFunction (Sacha Viscaino)
• b84bfcc Use map sorting json config in FRC (Pranjal Shankhdhar)
• e97afc8 Add QueryPreparer interface (Rohit Jain)
• bc873b8 Rename QueryPreparer to BuiltInQueryPreparer (Rohit Jain)
• dc7ccb4 Use querytype as key in QueryExecutionFactory map (Rohit Jain)
• bf0a94c Order map entries during HBO Canonicalization (Pranjal Shankhdhar)
• 1c9de99 Fix CI for next snapshot iteration PRs (Guy Moore)
• 50b0e44 Add custom plan translation in LocalExecutionPlanner (MJ Deng)
• 21a3bbe Canonicalize domain predicate in TableScanNode (Pranjal Shankhdhar)
• ba9ec30 Add more tests to TestPrestoSparkHttpWorkerClient.java (tanjialiang)
• e1552e5 Refactor TestingResponse to extract logic to be customizable by users (tanjialiang)
• a7f0851 [native] Allow overriding file system registration. (Amit Dutta)
• 4e96f4d Create REMOVE_NULLS function (Sacha Viscaino)
• 5adc7c0 Update Iceberg to 1.0.0 (Eduard Tudenhoefner)
• 0628c0d Fix weighted fair scheduling in disagg coordinator (Swapnil Tailor)
• d1b99ee Updated assert aggregation to include approximate equals (Christopher Graves)
• ccec184 update to build tar and docker image (Linsong Wang)
• 6091b4e add init Jenkinsfile (Linsong Wang)
• 87f543a Remove redundant distinct over group by (Feilong Liu)
• c6f6262 Improve HBO overhead with LIMIT (Pranjal Shankhdhar)
• 50e3bcf Fix flaky HBO tests (Pranjal Shankhdhar)
• c1f4254 [native] Temporarily disable HttpTest.outstandingRequests. (Sergey Pershin)
• 310e15d [native] Add two spill_memory_threshold session propertiess. (Sergey Pershin)

[wanglinsong]

release notes are updated
@rohanpednekar

[rohanpednekar]

Thank you @wanglinsong. LGTM!

Any idea how and why we create a missing release notes section?

Would also like to include the below features which are part of the missing release notes.

#18625
#16875

[rschlussel]

Thanks for putting these together! Did you confirm that none of the changes that were missing release notes should have them? Please check the check box for each one after you've either added a release note for it or confirmed that it does not need one.

Also, make sure to build the release notes and check them out locally (open the html files in a browser) to confirm that they look correct.

[rschlussel]

Also, you should squash all the commits together, as we'd like to have it all as one commit for merging.

[wanglinsong]

Also, you should squash all the commits together, as we'd like to have it all as one commit for merging.

This can be done during the merge: Squash and merge.

[wanglinsong]

Thanks for putting these together! Did you confirm that none of the changes that were missing release notes should have them? Please check the check box for each one after you've either added a release note for it or confirmed that it does not need one.

Also, make sure to build the release notes and check them out locally (open the html files in a browser) to confirm that they look correct.

@rschlussel here is the generated website.
https://oss-presto-release.s3.us-east-1.amazonaws.com/presto/html/release/release-0.279.html

[rschlussel]

Also, you should squash all the commits together, as we'd like to have it all as one commit for merging.

This can be done during the merge: Squash and merge.

we only allow rebase and merge because we don't want merge commits.

[wanglinsong]

Also, you should squash all the commits together, as we'd like to have it all as one commit for merging.

This can be done during the merge: Squash and merge.

we only allow rebase and merge because we don't want merge commits.

I have merged all updates into a single commit.

[wanglinsong]

@rschlussel could you share how I can update the docs website (https://prestodb.io/docs/current/) after release notes are updated?

[rschlussel]

You need to sync them to https://github.com/prestodb/prestodb.github.io. I think we used to have a script that did it, but I can't find it.