v1.2.702-nightly

What's Changed

Exciting New Features ✨

• feat: object warehouse support rbac by @TCeason in #17262
• feat: (semi-)sync table/field comments with the table being attached by @dantengsky in #17478
• feat(raft-log): enhance raft-log reliability and add compatibility tests by @drmingdrmer in #17510
• feat: add log.file.max_size and rolling test by @BohuTANG in #17508
• feat: csv/tsv/ndjson support querying file meta data. by @youngsofun in #17512
• feat(query): support explain(DECORRELATED,verbose) by @forsaken628 in #17518
• feat(query): add show_roles table function by @TCeason in #17517

Thoughtful Bug Fix 🔧

• fix(query): tpcds q69 fail by @forsaken628 in #17516

Code Refactor 🎉

• refactor: re-generate hint file after alter table operations by @dantengsky in #17511

Others 📒

• chore: modify license url by @TCeason in #17513
• chore: refine some fuse_time_travel_size related logs by @dantengsky in #17515

Full Changelog: v1.2.701-nightly...v1.2.702-nightly

v1.2.701-nightly

What's Changed

Exciting New Features ✨

• feat(query): add markov model function and feistel function for obfuscator by @forsaken628 in #17437
• feat(sqlsmith): fuzz test support more dbs as seed by @b41sh in #17489
• feat: SHOW CREATE TABLE add quote for ident by @KKould in #17505

Thoughtful Bug Fix 🔧

• fix: check table mutability in copy into by @dantengsky in #17480
• fix: impl hive disable_table_info_refresh for hive to avoid error when show table status from by @BohuTANG in #17484
• fix(binder): AggregateRewriter should skip the rewrite of Pivot.aggregate by @forsaken628 in #17483
• fix(query): unsupport datetime format item should not return panic error by @TCeason in #17490
• fix(binder): different UDAF call must have unique display_name by @forsaken628 in #17500

Code Refactor 🎉

• refactor: s3 region auto detect error add timeout/endpoint by @BohuTANG in #17482

Build/Testing/CI Infra Changes 🔌

• ci: add workflow to publish deb repo by @everpcpc in #17485
• ci: fix download deb packages by @everpcpc in #17486
• ci: fix gpg key for deb distribution by @everpcpc in #17487
• ci: add view sqlsmith test by @TCeason in #17472
• ci: package meta & query deb separately by @everpcpc in #17488

Others 📒

• chore(query): add placeholder parser by @sundy-li in #17481
• chore(ci): fix benchmark comment failure by @zhang2014 in #17492
• chore: add more log info(like temp dir) for the vacuum temp files hook by @BohuTANG in #17494
• chore(query): continue the vacuum query hook even aborted by @sundy-li in #17497
• chore: Split metactl into lib meta/control and bin metactl by @Xuanwo in #17496

New Contributors

• @KKould made their first contribution in #17505

Full Changelog: v1.2.700-nightly...v1.2.701-nightly

v1.2.700-nightly

What's Changed

Exciting New Features ✨

• feat(query): add table stats api to admin interface by @everpcpc in #17471
• feat: Use max/min to estimate ndv by @Xuanwo in #17468
• feat: add table option copy_dedup_full_path by @youngsofun in #17473

Thoughtful Bug Fix 🔧

• fix: InterpreterMetrics could subtract with overflow by @forsaken628 in #17461
• fix(query): fix stack overflow if excessive use of union all by @zhang2014 in #17475

Others 📒

• chore(ci): fix benchmark comment failure by @zhang2014 in #17470
• chore(query): add monotonicity function property by @sundy-li in #17469

Full Changelog: v1.2.699-nightly...v1.2.700-nightly

v1.2.699-nightly

What's Changed

Exciting New Features ✨

• feat(binder): support update from by @Dousir9 in #17464

Thoughtful Bug Fix 🔧

• fix(query): fix bind internal column by @b41sh in #17463
• fix(query): spill config should be mask by @forsaken628 in #17467
• fix(query): fix variant get string function auto cast null to SQL NULL by @b41sh in #17466

Full Changelog: v1.2.698-nightly...v1.2.699-nightly

v1.2.698-nightly

What's Changed

Exciting New Features ✨

• feat: deprecate prefix_filter and change default level of logging. by @youngsofun in #17444
• feat: Add hdfs support in iceberg and fill iceberg statistics by @Xuanwo in #17352
• feat: support specifying columns to include in the "Attach table" statement by @dantengsky in #17442
• feat(metrics): add progress metrics via collector by @flaneur2020 in #17359

Thoughtful Bug Fix 🔧

• fix(doc): fix load tpcds tpch document by @sundy-li in #17438
• fix(query): fix join subquery scalar rewrite by @sundy-li in #17441
• fix: fix inconsistency comment about bitmap by @forsaken628 in #17452
• fix(query): fix WindowPartitionTopNExchange painc with an empty block by @forsaken628 in #17453
• fix(parser): allow timestamp as a function name by @forsaken628 in #17455
• fix(query): fix order by derived column with limit return wrong values by @b41sh in #17457
• fix(query): fold constant subquery to build filter plan instead of join plan by @b41sh in #17448
• fix(query): fix left semi optimize to inner join by @sundy-li in #17458

Build/Testing/CI Infra Changes 🔌

• ci: fix missing return for stable release by @everpcpc in #17454
• ci: fix publish binary to R2 by @everpcpc in #17456

Others 📒

• chore: update enterprise edition license url by @TCeason in #17445
• chore(query): testing tpch/tpcds using 1G scale factor by @sundy-li in #17449
• chore(metrics): tune the histogram bucket for seconds/milliseconds by @flaneur2020 in #17197

Full Changelog: v1.2.697-nightly...v1.2.698-nightly

v1.2.697

What's Changed

Exciting New Features ✨

• feat: add server to admin udfs api by @everpcpc in #17141
• feat(sqlsmith): Support generate fuzz query sql by @b41sh in #17153
• feat(ci): add ttc (tcp testing container) by @sundy-li in #17160
• feat(query): support direct the spill data to a different bucket by @forsaken628 in #17159
• feat(cluster): support system-managed cluster by @zhang2014 in #17051
• feat(query): support send spill file stats to client by @sundy-li in #17186
• feat(query): load ndjson support ts with diff units. by @youngsofun in #17203
• feat(sqlsmith): fuzz query support sqllogic test cases by @b41sh in #17216
• feat: hilbert clustering by @zhyass in #17045
• feat: support vacuum aggregating index by @SkyFan2002 in #17231
• feat(cluster): support warehouse level show processlist and kill query by @zhang2014 in #17249
• feat: orc support fill missing tuple field by @youngsofun in #17247
• feat(sqlsmith): fuzz test support read Sqlite and Duckdb test by @b41sh in #17301
• feat(ddl): support alter table cast tuple type column by @b41sh in #17310
• feat: support vacuum inverted index by @SkyFan2002 in #17291
• feat: Add disable_list_batch for webhdfs by @Xuanwo in #17345
• feat: Add username support for webhdfs by @Xuanwo in #17350
• feat(ddl): Support add stored computed column by @b41sh in #17347
• feat: introduce block meta cache by @dantengsky in #17360
• feat(query): support desc procedure by @TCeason in #17364
• feat(query): support Support from to simplify select * from by @TCeason in #17372
• feat(query): Virtual column support alias name by @b41sh in #17365
• feat(query): support timestamp diff return interval type by @TCeason in #17381
• feat(query): support extract EPOCH from timestamp by @TCeason in #17385
• feat(query): interval support agg func sum by @TCeason in #17379
• feat(query): support DATE_TRUNC('WEEK', EXPR)->DATE by @TCeason in #17407
• feat(auth): auto retry on jwks key not found by @flaneur2020 in #17410
• feat(query): Allow extract parts from interval type by @TCeason in #17417
• feat(query): array function support variant type as argument by @b41sh in #17428
• feat(query): add bucket name to storage http request metrics by @everpcpc in #17431
• feat: deprecate prefix_filter and change default level of logging. by @youngsofun in #17444

Thoughtful Bug Fix 🔧

• fix(ci): flaky test by @zhyass in #17149
• fix(query): return semantic error for SRFs in WHERE and HAVING clauses by @takaebato in #17167
• fix(cluster): disable forward warehouse request in self-managed cluster by @zhang2014 in #17176
• fix(query): check state is allocated or not when oom by @sundy-li in #17179
• fix(cluster): fix unassign warehouse nodes failure by @zhang2014 in #17195
• fix(cluster): skip the recovery for warehouses that are not running state. by @zhang2014 in #17193
• fix(query): fix aggregating index conflict with min/max rewrite by @b41sh in #17182
• fix: name resolution bug in quoted ident case sensitive mode by @zhyass in #17198
• fix(query): record state_rows in aggregate payload by @sundy-li in #17194
• fix: system.tables table visibility by @TCeason in #17202
• fix(query): interval total microseconds add overflow check by @TCeason in #17215
• fix(cluster): fix warehouse audit log not working with add cluster by @zhang2014 in #17219
• fix(query): fix register function working with nullable scalar by @sundy-li in #17217
• fix(query): stick the created_by infos in parquet writer by @sundy-li in #17220
• fix: Upload to stage in streaming way instead by @Xuanwo in #17230
• fix(cluster): fix heartbeat self managed after network fail by @zhang2014 in #17241
• fix(query): fix array_agg failed if the argument is NULL by @b41sh in #17244
• fix(query): increase state_rows in copy agg state rows by @sundy-li in #17252
• fix(query): hash table scatter will always send agg meta by @sundy-li in #17245
• fix(query): fix lazy columns missed in constant table scan by @Damon07 in #17258
• fix: vacuum index not work if index is dropped by create or replace by @SkyFan2002 in #17263
• fix(query): window function support params by @b41sh in #17282
• fix: copy into table collect files twice some times. by @youngsofun in #17300
• fix: set query_kind earlier to ensure it takes effect. by @youngsofun in #17302
• fix: use full path as cache key for parquet meta. by @youngsofun in #17313
• fix: column not found in analyze by @zhyass in #17321
• fix(query): unsupport datetime format item should not return panic error by @TCeason in #17323
• fix: support returning rows larger than 10MB. by @youngsofun in #17344
• fix(query): fix histogram binder and checker by @sundy-li in #17342
• fix(query): add check window frame by @sundy-li in #17316
• fix(query): RawValueSource::parse_fallback fully parse input by @forsaken628 in #17340
• fix(query): aviod building TransformSortMergeLimit with a big number limit by @forsaken628 in #17339
• fix(query): disallow push down filters that use columns in window order by columns or function argument columns by @forsaken628 in #17353
• fix(query): procedure support string type by @TCeason in #17325
• fix(query): interval order by is incorrect by @forsaken628 in #17357
• fix(query): cast string to timestamp overflow by @TCeason in #17376
• fix(query): fix time parser with enable_strict_datetime_parser = 0 by @sundy-li in #17399
• fix(query): fix lambda function bind column failed by @b41sh in #17402
• fix(query): fix months_between overflow error by @TCeason in #17403
• fix(query): interval type support cast to string by @TCeason in #17395
• fix(query): Align TRIM functions semantically with Snowflake by @forsaken628 in #17375
• fix(query): fix resolve decimal by @sundy-li in #17409
• fix(ci): fix Link Checker by @sundy-li in #17416
• fix(query): to_yyyymmddhhmmss only support timestamp type by @TCeason in #17422
• fix(query): group checker subquery by @sundy-li in #17420
• fix(query): support vacuum temp files for create and refresh by @zhang2014 in #17421
• fix(query): if arg is Scalar::null or a null column ignore null will invalid by @TCeason in #17423
• fix(query): cte recursive check by @sundy-li in #17427
• fix(query): fix variant value can not cast to not null type by @b41sh in #17434
• fix(doc): fi...

v1.2.697-nightly

What's Changed

Exciting New Features ✨

• feat(query): add bucket name to storage http request metrics by @everpcpc in #17431

Code Refactor 🎉

• refactor(query): refactor variant cast to types by @sundy-li in #17435

Full Changelog: v1.2.696-nightly...v1.2.697-nightly

v1.2.696-nightly

What's Changed

Exciting New Features ✨

• feat(query): array function support variant type as argument by @b41sh in #17428

Thoughtful Bug Fix 🔧

• fix(query): fix variant value can not cast to not null type by @b41sh in #17434

Build/Testing/CI Infra Changes 🔌

• ci: fix release type for nightly cron by @everpcpc in #17429

Others 📒

• chore(query): add new session setting: query_tag by @TCeason in #17430

Full Changelog: v1.2.695-nightly...v1.2.696-nightly

v1.2.695-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix(query): cte recursive check by @sundy-li in #17427

Others 📒

• chore: use Box::leak() to ensure logging guard lives for the program's lifetime by @drmingdrmer in #17425
• chore(query): cast variant to other type allow cast JSON null as SQL NULL by @b41sh in #17412

Full Changelog: v1.2.694-nightly...v1.2.695-nightly

v1.2.694-nightly

What's Changed

Exciting New Features ✨

• feat(query): interval support agg func sum by @TCeason in #17379
• feat(query): support DATE_TRUNC('WEEK', EXPR)->DATE by @TCeason in #17407
• feat(auth): auto retry on jwks key not found by @flaneur2020 in #17410
• feat(query): Allow extract parts from interval type by @TCeason in #17417

Thoughtful Bug Fix 🔧

• fix(query): Align TRIM functions semantically with Snowflake by @forsaken628 in #17375
• fix(query): fix resolve decimal by @sundy-li in #17409
• fix(ci): fix Link Checker by @sundy-li in #17416
• fix(query): to_yyyymmddhhmmss only support timestamp type by @TCeason in #17422
• fix(query): group checker subquery by @sundy-li in #17420
• fix(query): support vacuum temp files for create and refresh by @zhang2014 in #17421
• fix(query): if arg is Scalar::null or a null column ignore null will invalid by @TCeason in #17423

Code Refactor 🎉

• refactor: refine replace into by caching individual BlockMeta by @dantengsky in #17368

Others 📒

• chore(udf): tune the log message about udf decode error by @flaneur2020 in #17414
• chore: refine copy into tests by @dantengsky in #17413
• chore(metrics): add metric about opendal retries count by @flaneur2020 in #16724
• chore: Use tagged version of opendal by @Xuanwo in #17419

Full Changelog: v1.2.693-nightly...v1.2.694-nightly