[TEST] Add release notes for 0.249

[ajaygeorge]

Missing Release Notes

Andrii Rosa

• b888504 Revert "Add PrestoSparkMetadataStorage"
• 21aec09 Revert "Add optional sqlLocation to PrestoSparkRunner"
• 91b907c Revert "Add metadataStorage to PrestoSparkConfiguration"

Ariel Weisberg

• Update joda to 2.10.8 tzdata 2020d #15787 Update joda to 2.10.8 tzdata 2020d (Merged by: Rebecca Schlussel)
• Add new_partition_user_supplied_parameter property #15778 Add new_partition_user_supplied_parameter property (Merged by: Andrii Rosa)

Arjun Gupta

• Support distribution of broadcast table using disk storage in Presto-on-Spark #15669 Support distribution of broadcast table using disk storage in Presto-on-Spark (Merged by: Andrii Rosa)

John Roll

• Add Checksum CRC32 to Exchange SerializedPage #15686 Add Checksum CRC32 to Exchange SerializedPage (Merged by: Andrii Rosa)

agrawalreetika

• Add readonly for file based system access control #15715 Add readonly for file based system access control (Merged by: Andrii Rosa)

imjalpreet

• Upgrade to Hive 3.0.0 #15659 Upgrade to Hive 3.0.0 (Merged by: Rebecca Schlussel)

Extracted Release Notes

• Check total memory limit when allocating user memory #15723 (Author: Rebecca Schlussel): Check total memory limit when allocating user memory
  • Enforce max_total_memory_per_node on user memory allocation.
• Fix LocalExecutionPlan for IndexJoin when spill enabled #15773 (Author: Rebecca Schlussel): Fix LocalExecutionPlan for IndexJoin when spill enabled
  • Fix an error executing index joins when join spilling is enabled.
• Upgrade hadoop-apache for refreshing S3 FileSystem Cache on Credential Change #15800 (Author: imjalpreet): Upgrade hadoop-apache for refreshing S3 FileSystem Cache on Credential Change
  • Fix a bug when S3 access is compromised across s3 enabled hive catalogs (:pr:15800).
• Upgrade to Hive 3.0.0 #15805 (Author: imjalpreet): Upgrade to Hive 3.0.0
  • Add Support for Hive Connector to work with Hive 3 metastore for basic tables (ACID Tables and tables using constraints are not supported yet) (:pr:15805).
• Upgrade to Hive 3.0.0 #15805 (Author: imjalpreet): Upgrade to Hive 3.0.0
  • Add Support for Hive Connector to work with Hive 3 metastore for basic tables (ACID Tables and tables using constraints are not supported yet) (:pr:15805).

All Commits

• 51c7888 Revert "Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit" (Rongrong Zhong)
• a789c3c Fix reading collection delimiter set by Hive < 3.0 (imjalpreet)
• 3de32e6 Update to Hive 3.0.0 (imjalpreet)
• 16e6006 Upgrade hadoop-apache for refreshing S3 FileSystem Cache on Credential Change (imjalpreet)
• 6619eeb Revert "Update to Hive 3.0.0" (Neerad Somanchi)
• bf6be9a Minor improvement to SpillableFinalOnlyGroupedAccumulator (James Petty)
• 9f44884 Bump up alluxio version (Ke Wang)
• 1f1b1d1 Configure tempstorage for Presto on Spark (Arjun Gupta)
• dfc6aeb Update hive-apache to 3.0.0-3 (James Petty)
• 06f38c3 Update joda to 2.10.8 tzdata 2020d (Ariel Weisberg)
• fa8874f Fix Input Rows reporting in TableScan operators (Masha Basmanova)
• e4a1d66 Add new_partition_user_supplied_parameter property (Ariel Weisberg)
• 0d5ed03 Improve processing time for Presto on spark events (Arjun Gupta)
• 87e84b2 Deprecate Joda library in Presto Teradata functions (Vladimirs Kotovs)
• 97ac497 Documentation for Metastore configurations (agrawalreetika)
• dcdedee Fix overallocation of RowBlockBuilders during aggregation spill (Saksham Sachdev)
• a66d912 Enforce fixed distribution for output operator (Andrii Rosa)
• b1f85b6 Add metadataStorageType to PrestoSparkConfiguration (Vic Zhang)
• ab351bf Add optional sqlLocation to PrestoSparkRunner (Vic Zhang)
• e7826a8 Add PrestoSparkMetadataStorage (Vic Zhang)
• 1b72d26 Fix LocalExecutionPlan for IndexJoin when spill enabled (Rebecca Schlussel)
• b888504 Revert "Add PrestoSparkMetadataStorage" (Andrii Rosa)
• 21aec09 Revert "Add optional sqlLocation to PrestoSparkRunner" (Andrii Rosa)
• 91b907c Revert "Add metadataStorage to PrestoSparkConfiguration" (Andrii Rosa)
• 8471524 Add metadataStorage to PrestoSparkConfiguration (Vic Zhang)
• ad1753e Add optional sqlLocation to PrestoSparkRunner (Vic Zhang)
• 474d584 Add PrestoSparkMetadataStorage (Vic Zhang)
• 4fb6586 Allow adjusting broadcast memory via session property for PoS (Arjun Gupta)
• c372c58 Register UNKNOWN type same way as other types (Rongrong Zhong)
• bd93326 Implement storage based broadcast join in Presto on Spark (Arjun Gupta)
• fd32fea Update to Hive 3.0.0 (imjalpreet)
• 8665788 Stop using Travis in favor of GH actions (Ariel Weisberg)
• b043970 Upgrade fastutil to 8.5.2 (Arunachalam Thirupathi)
• e7a85b3 Support enums in SQL functions (Rongrong Zhong)
• 6259ff3 CI cache maven repo (Ariel Weisberg)
• b29e782 Refactor TempStorage interface (Andrii Rosa)
• a6b1abb Enable TestBlockBuilder.testNewBlockBuilderLikeForLargeBlockBuilder (Ariel Weisberg)
• e360668 Add product tests to ci.yml (Ariel Weisberg)
• a1cd3c1 Add Checksum CRC32 to Exchange SerializedPage (John Roll)
• e2ceb67 Skip OOMing testNewBlockBuilderLikeForLargeBlockBuilder (Ariel Weisberg)
• 23f621f Add "America/Nuuk" time zone (Ariel Weisberg)
• 5f5bbe7 Cherry-pick GH actions scripts from TrinoDB (Ariel Weisberg)
• 06f7801 Add readonly for file based system access control (Reetika Agrawal)
• f6b77ca Support named types in Type and TypeSignature (Rongrong Zhong)
• 0a8158f Allow adjusting memory limits with session properties (Arjun Gupta)
• 2358b01 Update build badge url from travis-ci.org to travis-ci.com (Ajay George)
• 26a373c Add cpu and memory stats to NodeTaskMap (Cem Cayiroglu)
• 201ef82 Fix task worker host url (Ajay George)
• 6b5268a Fix adjusted queue size calculation (Mayank Garg)
• d3aea63 Reorder Data Streams in OrcWriter (Arunachalam Thirupathi)
• 4aa0e32 Remove obsolete comment about spill (Rebecca Schlussel)
• d86c679 Check total memory limit when allocating user memory (Rebecca Schlussel)
• 29a5e12 Supports complex types in reduce_agg (Wenlei Xie)

[ajaygeorge]

@aweisberg I debugged the release notes generation tool.
The issue with #15787 and #15778 are the trailing depends on . The release notes generation tool seems to be a bit strict about any lines coming after the release part. Not sure if there was any historical reason for this.

[aweisberg]

I know. It doesn’t always work even without trailing text. See John’s PR.

[ajaygeorge]

@aweisberg For John's PR the issue is that it doesn't contain a Section Header like General Changes

[aweisberg]

Thanks for figuring that out.