Skip to content

Add release notes for 0.283#20402

Merged
wanglinsong merged 1 commit intoprestodb:masterfrom
wanglinsong:release-notes-0.283
Aug 15, 2023
Merged

Add release notes for 0.283#20402
wanglinsong merged 1 commit intoprestodb:masterfrom
wanglinsong:release-notes-0.283

Conversation

@wanglinsong
Copy link
Member

Missing Release Notes

Amit Dutta

Ankur Pathela

Avinash Jain

Bikramjeet Vig

Eduard Tudenhoefner

Elliotte Rusty Harold

Jaromir Vanek

Jialiang Tan

Jimmy Lu

Karteekmurthys

Linsong Wang

Lyublena Antova

Masha Basmanova

Miguel Blanco Godón

Pedro Eugenio Rocha Pedreira

Pratyush Verma

Rohan Pednekar

Sotirios Delimanolis

wypb

Extracted Release Notes

All Commits

  • 6bb3164 Expose QueryManagerStats in JMX under DispatchManager namespace (Jalpreet Singh Nanda (:imjalpreet))
  • ae36752 Fix computation of QueuedQueries JMX metric (Jalpreet Singh Nanda (:imjalpreet))
  • e81cfb4 Stop computing queued queries in QueryManagerStats#trackQueryStats (Jalpreet Singh Nanda (:imjalpreet))
  • 39b4d05 Add documentation on how to invalidate hive metastore cache and list files cache (Jalpreet Singh Nanda (:imjalpreet))
  • 28fb8db Revert "Upgrade Alluxio version to 301" (Rohit Jain)
  • 3db67b0 [Native] Add scaled-writer support in prestissimo (Ke)
  • 8f9f9ba Introduce AlternativeNullableLongStateSerializer for presto native (Ke)
  • f852f66 [native pos] Use CompactRow serde for shuffle (Masha Basmanova)
  • 7708096 [native] Add all parquet tests to a test group (Michael Shang)
  • e1719d0 Disable “Product Tests Specific 2.6” run (Michael Shang)
  • 406a05c Remove inheritence relationship between AsyncDataCache and MemoryAllo… ([native] Remove inheritence relationship between AsyncDataCache and MemoryAllo… #20372) (Jialiang Tan)
  • 9d6a45f [native] Add support for SYSTEM TABLESAMPLE (aditi-pandit)
  • c0c7b58 [native] Fix spill config name. (Amit Dutta)
  • 6e969d9 [native pos] Fail the query if timed out fetching results from Velox (Masha Basmanova)
  • 497d51f [native] Advance Velox (Masha Basmanova)
  • 6f1ba2a Add Shrinidhi as codeowner for presto-spark* modules (Rebecca Schlussel)
  • e532e79 [native pos] Refactor TestPrestoSparkHttpClient (Masha Basmanova)
  • ebee09c [native] Make node optional in spill path. (Amit Dutta)
  • fbc8f74 [native]Advance velox version (xiaoxmeng)
  • 342dd5f Add timeout for HBO stats fetch (feilong-liu)
  • c5e69ed Add optimizer failure field to PlanOptimizerInformation (feilong-liu)
  • 7cd1a41 Add cache for jdbc metadata calls (Nikhil Collooru)
  • bc477b2 [native pos] Remove unused member variable (Masha Basmanova)
  • c55c23e [native pos] Fix log message (Masha Basmanova)
  • c49fe11 Enable Presto-on-Spark to use multiple retry strategies after failure (Jaromir Vanek)
  • 532e77f Support S3FileIO in Hadoop and Nessie backed Iceberg tables. (Hunter Madison)
  • fe4d5ab [native] Reduce histogram counter width (Pranjal Shankhdhar)
  • 336db7e Remove Presto Server RPM (Rebecca Schlussel)
  • 88b4348 [native pos] Add end to end functionality for file based broadcast (Chandrashekhar Kumar Singh)
  • 2753a20 [native] Advance velox version (Pranjal Shankhdhar)
  • 26cfa7e [native] Remove dependency on nodeConfig.nodeMemoryGb (Jialiang Tan)
  • cfc51c0 Remove IMemoryManager interface (Jialiang Tan)
  • e1b6f76 [native] Map internal aggregate function names (Karteekmurthys)
  • d541525 Add to configure reclaimer for arbitration (xiaoxmeng)
  • 8f6b2ab Fix the positin read in ByteArraySeekableStream in local cache test code (Beinan)
  • 32864ec Upgrade Alluxio version to 301 (Beinan)
  • e87320b HBO: add cache for input table statistics (feilong-liu)
  • c19003e [native] Add e2e test for aggregation companion function (Wei He)
  • dca39c2 [native] Fix presto_server_test build failure on MacOS (wypb)
  • 3e573ec Fix critical severity security vulnarabilities (Haritha Koloth)
  • 2ced880 Minor formatting fixes for ParquetReader (yingsu00)
  • bbd7293 Fix ParquetWriter.getWrittenBytes() (yingsu00)
  • 2519435 [native] Add e2e tests for window value functions (Pramod)
  • 1ea75d9 Update Jenkinsfile to upload build artifacts to public repos (Linsong Wang)
  • aae13e8 Use custom executor for Exchange (Pranjal Shankhdhar)
  • 4670d50 Remove unneeded identity projects (Anant Aneja)
  • ee896c8 [native] Add support for distinct aggregations (Masha Basmanova)
  • ef5520c [native]Advance velox version (wypb)
  • 094ca50 Add support for NO_VALUES_MATCH UDF (Avinash Jain)
  • 9cf9cc8 [native]Advance velox version (xiaoxmeng)
  • 0cbc931 [native] Advance Velox (Deepak Majeti)
  • 6156d4a Update Drift dependency to use Header transport by default (Sotirios Delimanolis)
  • 0022a2e Presto on Spark log functions invoked in query (Jiayan Wei)
  • 2a831dc [native]Rename memory arbitration related configs (xiaoxmeng)
  • 8a281d3 [native] Fix the problem that the Python.h file cannot be found when executing the setup-centos.sh script. (wypb)
  • a2c35e4 [native pos] Add serializedBytes runtime stats to PartitionAndSerialize (Masha Basmanova)
  • 5ff964c Add stats for Metastore table and partition names cache (Nikhil Collooru)
  • 40fb551 [native] Add first version of json function signature parser (Pedro Eugenio Rocha Pedreira)
  • fe50801 [native] Add e2e test for array flatten function (Zac)
  • 984ad88 [native] Remove unnecessary prefix in e2e test (Zac)
  • 59ea9dc [native]Add multi table writer driver support (xiaoxmeng)
  • 57b0562 Add server operation to print task debug details (Pranjal Shankhdhar)
  • 5884808 Remove SocketChannelSocketFactory (Miguel Blanco Godón)
  • 00ed8e2 [native] Disable Q64 in tpc-ds due to flakiness in CI (frankobe)
  • f375af2 [native] Add node information in spill path. (Amit Dutta)
  • a536555 Add a pereiodic yield signal to Prestissimo (Ge Gao)
  • 7a0616a Notify aditi-pandit on SQL language changes (aditi-pandit)
  • 62bb876 [native pos] Make sure to drain page buffer on success (Masha Basmanova)
  • 1a67372 [native pos] Add logging to help root cause data loss (Masha Basmanova)
  • 650ca5d [Native] Pass down column stats aggregation info into TableWriterNode (Ke)
  • b65b500 Change the function name for MaxDataSize and SumDataSize (Ke)
  • 8d86ad9 Add tests for json registration of functions with complex types ([native pos] Add tests for json registration of functions with complex types #20298) (Pedro Eugenio Rocha Pedreira)
  • 66c897a Introduce a session property to print the before and after plan node of specified optimizations (Lyublena Antova)
  • 8e66c15 Notify elharo on language changes (Elliotte Rusty Harold)
  • f08fe8d [native pos] Detect CPP process crash and fail native task (Shrinidhi Joshi)
  • a050f31 [native pos] Refactor HttpNativeExecutionTaskInfoFetcher (Shrinidhi Joshi)
  • 5bac9d4 [native pos] Fix warning on failure to update metrics (Masha Basmanova)
  • 1456062 Add helper method getValueLowerCase in Identifier (Ajay George)
  • 79b291e [native pos] Fix presto protocol generation by correcting java file path (Chandrashekhar Kumar Singh)
  • f6064ba Add support for ANY_VALUES_MATCH function (Melissa Guo)
  • 1250341 [pos] Remove BatchTaskUpdateRequest log line to mitigate TimeoutException (Ali Parsaei)
  • 1817a0e Add codenotify workflow and rule for sql changes (Rebecca Schlussel)
  • 76863c1 [native pos] Propagate taskInfo updates to Spark metrics (Shrinidhi Joshi)
  • 8f66352 Fix the performance problem of InternalResourceGroup.getActiveWorkCount (Dongsheng Wang)
  • 9f2f540 [Native] Add physicalWrittenBytes in task status (Ke)
  • 872b599 [native pos] update README for presto_protocol generation (Chandrashekhar Kumar Singh)
  • c1e3193 [native] Add e2e tests for array_sort lambda function (Masha Basmanova)
  • b280321 [native] Advance Velox (Masha Basmanova)
  • 8a66e0e [native] Advance velox. (Amit Dutta)
  • 96c0dcd Minor SqlQueryExecution refactoring (Ajay George)
  • c76c9f9 [native] Advance Velox (Masha Basmanova)
  • bac1a78 [native] Add e2e test for array concat presto function (Zac)
  • 40d0109 [native pos] Refactor dependency injection wiring for extensibility (Pratyush Verma)
  • 7bb3988 [native] Fail fast on distinct aggregations (Masha Basmanova)
  • ef25319 Do not repartition in local exchange for partial row number node (feilong-liu)
  • 388a942 [native] Address nits in PrestoExchangeSource (Pranjal Shankhdhar)
  • caa5acb [native] Pass data columns to Velox (Jimmy Lu)
  • 5534a43 Update release-0.282.rst (Rohan Pednekar)
  • 3271f7a Optimize LIKE for simple prefix matches (Sreeni Viswanadha)
  • 2e19564 [native] Minor log fixes. (Amit Dutta)
  • 2074845 [native]Advance velox version (xiaoxmeng)
  • b6e98da Skip duplicate merge in hll. (Amit Dutta)
  • a4abedd Print plan cost estimation source in query plan (feilong-liu)
  • 425c38d Update Jenkins pipeline to support deploying a cluster based on a PR as branch name (Linsong Wang)
  • 49998a0 Add backoff to Exchange requests (Pranjal Shankhdhar)
  • 6602fd8 Update Velox submodule (Bikramjeet Vig)
  • 507ca0c Convert DATE to logical type (Fix joins to check for coerced types #5015) (Aditi Pandit)
  • d3a9946 [native] Fail fast when dereferencing anonymous fields (Masha Basmanova)
  • bf923f6 [native] Disable flaky test (pratyakshsharma)
  • 8a708e6 [native pos] Refactor package structure of presto-spark-base (Pratyush Verma)
  • 32d1b12 [native pos] Skip creating empty broadcast files (Chandrashekhar Kumar Singh)
  • a7fe2a9 Describe ScyllaDB storage support in connectors docs (Maxim Korolyov)
  • 6717dd0 [native pos] Check null pointer before use in spark test (Ke)
  • e101371 [native] Expose getLocalIp to support ip per task. (Amit Dutta)
  • 73d64a9 Fix critical severity security vulnerabilities (Arin Mathew)
  • 864619d Optimize CASE expressions using only literals (Sreeni Viswanadha)
  • 4d1bb73 [native]Add TableWriterMergeNode node (xiaoxmeng)
  • 230eb3d [native] Add e2e test for 3 arg min_by/max_by aggregate function (Pratyush Verma)
  • a7dda16 [native] Advance velox (Pratyush Verma)
  • 78c7c31 Add option to add partial row number node (feilong-liu)
  • 319c2d1 Add is partial field to row number node (feilong-liu)
  • 18e047b [native] Handle same type NULLIF argument (Pratyush Verma)
  • 56b3dfb Choose broadcast join when one side is small the other side is unknown (feilong-liu)
  • 1d331e0 [native] Advance velox and disable nullif tests. (Amit Dutta)
  • 82a5692 Revert "[native] Revert NULLIF specialForm support" (Pratyush Verma)
  • dee9705 [native] Revert NULLIF specialForm support (Pratyush Verma)
  • 952d2a6 update oracle connector docs (Linsong Wang)
  • 420af67 [native] Random delay in announcement. (Amit Dutta)
  • e291329 [native] Handle NULLIF without the need for specialForm (Pratyush Verma)
  • 2f351ff [refactor] Pass functionAndTypeManager to SqlToRowExpressionTranslator (Pratyush Verma)
  • 1d50e60 Revert "[native] set allow table drop option in hive config" (Amit Dutta)
  • a87de0e [native]Add to config memory arbitration in Prestissimo (xiaoxmeng)
  • 88c5485 Support worker isolation using worker pool (abhiseksaikia)
  • c3dbf9a [Native] Add e2e test for table writer special partition name (Ke)
  • cbf7a77 [native] set allow table drop option in hive config (xiaoxmeng)
  • 9e1e159 [native] Use different commit strategies in Velox query plan converters (Ge Gao)
  • 6570b00 [native]Add non-sorted bucket write support (xiaoxmeng)
  • c275241 [Native] Introduce outputVariables in StatisticAggregations (Ke)
  • 4b267a0 Introduce outputVariables in StatisticAggregations (Ke)
  • b31b6e5 [native] Fix TestTypeSignature (Pratyush Verma)
  • 435ca0c [native] Log Zombie task info (Pranjal Shankhdhar)
  • 662d874 Expose 'partial' flag for TopNRowNumberNode in PlanPrinter (Masha Basmanova)
  • fec326b [native] Enable Q2, Q78 in tpc-ds (frankobe)
  • a8fa471 [native] Add type convert for IntervalYearMonthType (Ke)
  • d7e653d [native pos] Fix dropping of columns in PartitionAndSerialize (Masha Basmanova)
  • cb15ac0 [native] Fix translation for TopNRowNumberNode (Masha Basmanova)
  • 71ea71c [native] Advance Velox version. (Sergey Pershin)
  • 5919a5a Update Drift and Netty dependencies to support TLS 1.3 (Sotirios Delimanolis)
  • c1cc781 Add missing setter for optimizePayloadJoins in FeatureConfig (Lyublena Antova)
  • c5db905 Add support for no_keys_match function (Avinash Jain)
  • aaab915 [native pos] Enable testDateFilter and testCreateUnpartitionedTableAsSelect (Masha Basmanova)
  • 4522def [native] Remove PRESTO_ENABLE_PARQUET definition (Deepak Majeti)
  • 14c50ef Add support for any_keys_match function (Avinash Jain)
  • bc2ec73 Remove redundant throws clause (Ajay George)
  • 05dcda3 [native] Link velox_dwio_parquet_reader/writer unconditionally (Masha Basmanova)
  • 529dd4c [native pos] Simplify replicate-nulls-and-any logic (Masha Basmanova)
  • d7d472b [native] Remove PRESTO_ENABLE_PARQUET logic from PrestoServer.cpp (Masha Basmanova)
  • b77ffc5 [Native] Enable reorder warning (Deepak Majeti)
  • 28f3ee0 [native] Add e2e test for insert into partitioned table (Ge Gao)
  • 2a1ce0b [native pos] Remove busy-waiting-loop to reduce the CPU usage (Miaojiang (MJ) Deng)
  • d4df80b Revert "[native] Randomize retry time with jitter after worker announcement failure." (frankobe)
  • 6e1f475 Add support for all_keys_match function (Avinash Jain)
  • 4dc0826 Fix MergeJoinNode does not have a Graphviz visitor (Masha Basmanova)
  • 0fd63de [native] Add support for SemiJoinNode (Masha Basmanova)
  • 535ece0 Fix build (Masha Basmanova)
  • f2d55d1 Revert drift version upgrade to fix netty errors (Ankur Pathela)
  • 8855a05 Add JWT for internal communication (Mahadevuni Naveen Kumar)
  • dda1983 [native] Add support for ValuesNode with expressions (Masha Basmanova)
  • edabfe0 [native] Add support and E2E tests for Parquet Writer (Deepak Majeti)
  • 675125e Fix issue while using iceberg table property format_version (imjalpreet)
  • b893d88 Add configs for ttl of Alluxio cache (Beinan)
  • e7f67da [native pos] Change thread pool initial size to 1 to reduce the CPU time (Miaojiang (MJ) Deng)
  • bfc8e3b [native]Add to call file sink registration in server startup (xiaoxmeng)
  • b0cde2e [native] Randomize retry time with jitter after worker announcement failure. (Amit Dutta)
  • c0eedcb [native] Add retry logic to Spark tests (v-jizhang)
  • 3b26dcd [Native] Add TPC-DS for parquet in presto-native-execution (frankobe)
  • 40554ce [native]Add register file sink interface to presto server (xiaoxmeng)
  • 5bb3162 Track applicable optimizations that were disabled with a flag (Lyublena Antova)
  • 0fcc287 [native] Make CircleCI linux build run only once for all tests containers (v-jizhang)
  • b5e27f4 [native] Disable native github actions job (Michael Shang)
  • 293277f [native] Advance velox. (Amit Dutta)
  • e8bcfef Update Iceberg from 1.2.1 to 1.3.0 (Eduard Tudenhoefner)
  • 024b792 Revert "Track applicable optimizations that were disabled with a flag" (Ge Gao)
  • 8a6ea31 [native] Fix presto-native-execution README for running setup-adapters script (imjalpreet)
  • 0b83c8d Add join output order check in JoinNode constructor (feilong-liu)
  • a433154 Update Drift and Netty dependencies to support TLS 1.3 (Sotirios Delimanolis)
  • a26bdf2 [native] Add e2e tests for array trim. (Amit Dutta)
  • b0384b1 [native pos] Move ShuffleWriter creation out of Task creation (Masha Basmanova)
  • 5ce9598 [native] Advance velox. (Amit Dutta)
  • 829d711 [native]Update Prestissimo code according to velox change (xiaoxmeng)
  • 089bbb1 [native] Add mappings for $internal$json_string_to_array/map/row_cast (Masha Basmanova)
  • ac8b3f6 [native pos] Enable TestPrestoSparkNativeGeneralQueries#testUnionAll (Miaojiang (MJ) Deng)
  • 38a404c Fix join output for cross join or optimizer rule (feilong-liu)
  • bc1273a Fix randomize null join key optimizer (feilong-liu)
  • 4e020ff Fix use-after-free in HTTP callbacks (Fix use-after-free in HTTP callbacks #19863) ([Native] Fix use-after-free in HTTP callbacks (#19863) #19865) (Pranjal Shankhdhar)
  • 8f9b5d4 [native] Add ccache to speed up build (v-jizhang)
  • 9969ee1 [native pos] allow drop table for native java test runner (Miaojiang (MJ) Deng)
  • 517d570 Add optimization rule to remove identity projection under project node (feilong-liu)
  • 23222a5 [Native] Update CI Image and advance Velox (Michael Shang)
  • 07b9712 adding starts_with and ends_with (Mikhail Slavoshevskii)
  • 4be65df [native] Add table name to pushdown enable check error message (Jimmy Lu)
  • 140a891 [native pos] Add broadcast read support for file based broadcast (Chandrashekhar Kumar Singh)
  • e4c8fb4 add e2etesting for beta_cdf (Ann Rose Benny)
  • bcdb21d [native]turn on bigint compile option for folly to support velox (xiaoxmeng)
  • 54149b8 [native] Split tests in E2E and run in parallel (v-jizhang)
  • 5039ce5 Track applicable optimizations that were disabled with a flag (Lyublena Antova)
  • a2ee05c Iceberg connector document update about metadata tables (Reetika Agrawal)
  • c0eb1b2 Remove documentation about Alluxio Structured Data Service (Bin Fan)
  • fa07644 [native pos] Add close method to IPrestoSparkTaskExecutorFactory (Shrinidhi Joshi)
  • 74b78ab [native pos] Remove NativeExecutionInfo special handling (Shrinidhi Joshi)
  • d00c77f [native pos] Remove NativeExecutionNode and NativeExecutionOperator (Shrinidhi Joshi)
  • f65fd09 [native pos] Update SparkMetrics integration to work with NativeTaskExecutorFactory (Shrinidhi Joshi)
  • 767b330 [native pos] Remove NativeExecutionNode plan rewrite (Shrinidhi Joshi)
  • 4c0ed65 [native pos] Add PrestoSparkNativeTaskExecutorFactory (Shrinidhi Joshi)
  • 37a0517 [native] Handle Date type in toFilter function (Ivan Sadikov)
  • 9f35166 Remove 'Experimental' Prefix from Dynamic Filtering as It's Now Stable (jaystarshot)
  • 8ec1756 Remove unused field in PrestoSparkAdaptiveQueryExecution (Rebecca Schlussel)
  • e63d359 Move shared methods to JoinSwappingUtils (Rebecca Schlussel)
  • cb83306 Add re-optimization step for AQE (Rebecca Schlussel)
  • b9bdd10 Fix PickJoinSides handling of local exchanges (Rebecca Schlussel)
  • 3b631b4 Fix formatting in DetermineJoinDistributionType (Rebecca Schlussel)
  • e4190fc Add RemoteSourceNode as option for size-based join (Rebecca Schlussel)
  • d4a459f Add PrestoSparkStatsCalculator to combine runtime and HBO stats (Rebecca Schlussel)
  • 297b692 Propagate statsEquivalentPlanNode for RemoteSource (Rebecca Schlussel)
  • c462797 Upgrade jansi to 1.18 (Chunxu Tang)
  • 8d10f04 Merge branch 'master' of https://github.com/prestodb/presto (Linsong Wang)
  • fc3ccc8 [native]Add bucket table check on write in Prestissimo (xiaoxmeng)

@wanglinsong wanglinsong requested a review from a team as a code owner July 27, 2023 17:30
@wanglinsong wanglinsong requested a review from presto-oss July 27, 2023 17:30
@github-actions
Copy link

github-actions bot commented Aug 15, 2023

Codenotify: Notifying subscribers in CODENOTIFY files for diff 20e31b2...0839475.

Notify File(s)
@steveburnett presto-docs/src/main/sphinx/release.rst
presto-docs/src/main/sphinx/release/release-0.283.rst

@wanglinsong
Copy link
Member Author

@tdcmeehan please approve.

@wanglinsong wanglinsong force-pushed the release-notes-0.283 branch 2 times, most recently from 0c53412 to b43e426 Compare August 15, 2023 20:26
@wanglinsong
Copy link
Member Author

@tdcmeehan thank you for the review. I have addressed your comments, and built locally to make sure the date stamp works for 0.283 link.

@tdcmeehan
Copy link
Contributor

Thanks @wanglinsong ! Can you also rebase on the latest master, that should fix the hanging circleci tests.

@wanglinsong
Copy link
Member Author

Thanks @wanglinsong ! Can you also rebase on the latest master, that should fix the hanging circleci tests.

done

@wanglinsong wanglinsong merged commit 5ea6d2b into prestodb:master Aug 15, 2023
@wanglinsong wanglinsong deleted the release-notes-0.283 branch August 15, 2023 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants