diff --git a/presto-docs/src/main/sphinx/connector/cassandra.rst b/presto-docs/src/main/sphinx/connector/cassandra.rst index c70c24fce6a61..44c6fc96a5bed 100644 --- a/presto-docs/src/main/sphinx/connector/cassandra.rst +++ b/presto-docs/src/main/sphinx/connector/cassandra.rst @@ -30,7 +30,7 @@ ScyllaDB uses the same port as Cassandra by default. Just point to ScyllaDB nodes in ``cassandra.contact-points`` config property. Multiple Cassandra or ScyllaDB Clusters -^^^^^^^^^^^^^^^^^^^^^^^^^^^ +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ You can have as many catalogs as you need, so if you have additional Cassandra(ScyllaDB) clusters, simply add another properties file to ``etc/catalog`` @@ -161,7 +161,7 @@ Property Name Description ============================================================= ====================================================================== Querying Cassandra or ScyllaDB Tables -------------------------- +------------------------------------- The ``users`` table is an example Cassandra table from the Cassandra `Getting Started`_ guide. It can be created along with the ``mykeyspace`` diff --git a/presto-docs/src/main/sphinx/connector/hive.rst b/presto-docs/src/main/sphinx/connector/hive.rst index bfb4dd9618961..72165a4973620 100644 --- a/presto-docs/src/main/sphinx/connector/hive.rst +++ b/presto-docs/src/main/sphinx/connector/hive.rst @@ -658,7 +658,7 @@ This query will collect statistics for 2 partitions with keys: * ``partition2_value1, partition2_value2`` Quick Stats --------------------------------------- +----------- The Hive connector can build basic statistics for partitions with missing statistics by examining file or table metadata. For example, Parquet footers can be used to infer @@ -874,7 +874,7 @@ columns as a part of the query like any other columns of the table. * ``$file_modified_time`` : Last file modified time for the given row (int64_t), in milliseconds since January 1, 1970 UTC How to invalidate metastore cache? ---------------------------------- +---------------------------------- The Hive connector exposes a procedure over JMX (``com.facebook.presto.hive.metastore.CachingHiveMetastore#flushCache``) to invalidate the metastore cache. You can call this procedure to invalidate the metastore cache by connecting via jconsole or jmxterm. diff --git a/presto-docs/src/main/sphinx/connector/hudi.rst b/presto-docs/src/main/sphinx/connector/hudi.rst index b2c1ca199f406..a2d8a346e56b7 100644 --- a/presto-docs/src/main/sphinx/connector/hudi.rst +++ b/presto-docs/src/main/sphinx/connector/hudi.rst @@ -1,6 +1,6 @@ -==================== -Hudi connector -==================== +============== +Hudi Connector +============== Overview -------- diff --git a/presto-docs/src/main/sphinx/connector/singlestore.rst b/presto-docs/src/main/sphinx/connector/singlestore.rst index a737cf5d8f13f..9be7a64826a54 100644 --- a/presto-docs/src/main/sphinx/connector/singlestore.rst +++ b/presto-docs/src/main/sphinx/connector/singlestore.rst @@ -1,6 +1,6 @@ -=============== +===================== SingleStore Connector -=============== +===================== The SingleStore connector allows querying and creating tables in an external SingleStore database. This can be used to join data between different @@ -66,9 +66,9 @@ If you used a different name for your catalog properties file, use that catalog name instead of ``singlestore`` in the above examples. SingleStore Connector Limitations ---------------------------- +--------------------------------- -The following SQL statements are not yet supported: +The following SQL statements are not supported: * :doc:`/sql/create-table` with ``rowstore`` table type (supports only ``columnstore`` table type, set by default `docs `_.) * :doc:`/sql/alter-schema` diff --git a/presto-docs/src/main/sphinx/connector/sqlserver.rst b/presto-docs/src/main/sphinx/connector/sqlserver.rst index 285a7852d1e38..2ca95955b76ee 100644 --- a/presto-docs/src/main/sphinx/connector/sqlserver.rst +++ b/presto-docs/src/main/sphinx/connector/sqlserver.rst @@ -25,7 +25,7 @@ connection properties as appropriate for your setup: Connection security ------------------- +------------------- The JDBC driver and connector automatically use Transport Layer Security (TLS) encryption and certificate validation. This requires a suitable TLS certificate configured on your SQL Server database host. @@ -75,7 +75,7 @@ if you name the property file ``sales.properties``, Presto will create a catalog named ``sales`` using the configured connector. General Configuration Properties ---------------------------------- +-------------------------------- ================================================== ==================================================================== =========== Property Name Description Default diff --git a/presto-docs/src/main/sphinx/ecosystem.rst b/presto-docs/src/main/sphinx/ecosystem.rst index 7dc16436a5bb8..28e715ec933a2 100644 --- a/presto-docs/src/main/sphinx/ecosystem.rst +++ b/presto-docs/src/main/sphinx/ecosystem.rst @@ -1,6 +1,6 @@ -***** +********* Ecosystem -***** +********* .. toctree:: :maxdepth: 1 diff --git a/presto-docs/src/main/sphinx/functions/comparison.rst b/presto-docs/src/main/sphinx/functions/comparison.rst index 149b1de2ab25d..aa615fd9434bc 100644 --- a/presto-docs/src/main/sphinx/functions/comparison.rst +++ b/presto-docs/src/main/sphinx/functions/comparison.rst @@ -238,7 +238,7 @@ Example:: Row comparison: NOT IN ------------------- +---------------------- The NOT IN comparison operator in SQL is used to exclude the rows that match any value in a list or subquery. diff --git a/presto-docs/src/main/sphinx/functions/math.rst b/presto-docs/src/main/sphinx/functions/math.rst index b064f934dd9a3..ebefc320df010 100644 --- a/presto-docs/src/main/sphinx/functions/math.rst +++ b/presto-docs/src/main/sphinx/functions/math.rst @@ -172,7 +172,7 @@ Mathematical Functions assumed to be in sorted ascending order. Probability Functions: cdf ------------------------ +-------------------------- .. function:: beta_cdf(a, b, value) -> double @@ -230,7 +230,7 @@ Probability Functions: cdf Probability Functions: inverse_cdf ------------------------ +---------------------------------- .. function:: inverse_beta_cdf(a, b, p) -> double @@ -297,7 +297,7 @@ Probability Functions: inverse_cdf Statistical Functions ------------------------ +--------------------- .. function:: wilson_interval_lower(successes, trials, z) -> double diff --git a/presto-docs/src/main/sphinx/overview/concepts.rst b/presto-docs/src/main/sphinx/overview/concepts.rst index bb12c7d355a28..e5c8eb4e2cf5f 100644 --- a/presto-docs/src/main/sphinx/overview/concepts.rst +++ b/presto-docs/src/main/sphinx/overview/concepts.rst @@ -31,7 +31,7 @@ There are three types of Presto servers: resource manager, coordinators and work following section explains the difference between them. Resource Manager -^^^^^^^^^^^ +^^^^^^^^^^^^^^^^ The Presto resource manager is the server that aggregates data from all coordinators and workers and constructs a global view of the cluster. diff --git a/presto-docs/src/main/sphinx/plugin/redis-hbo-provider.rst b/presto-docs/src/main/sphinx/plugin/redis-hbo-provider.rst index 41d3fbc6a43c9..9b36030dcfd9c 100644 --- a/presto-docs/src/main/sphinx/plugin/redis-hbo-provider.rst +++ b/presto-docs/src/main/sphinx/plugin/redis-hbo-provider.rst @@ -32,8 +32,8 @@ Property Name Description ``hbo.redis-provider.cluster-mode-enabled`` Boolean property whether cluster mode is enabled ============================================ ===================================================================== -Coordinator Configuration for Historical Based Optimization: ------------------------- +Coordinator Configuration for Historical Based Optimization +----------------------------------------------------------- These properties must be configured on the Presto coordinator in ``etc/config.properties`` for tracking and using historical statistics in planning: @@ -54,8 +54,8 @@ Credentials The plugin requires the Redis Server URI property ``hbo.redis-provider.server_uri`` to access Redis. Based on your custom Redis deployment, you may need to add additional credentials. -Local Test setup ------------------------- +Local Test Setup +---------------- 1. Set up a local Redis cluster following the Redis documentation to `Create a Redis Cluster `_. @@ -74,7 +74,7 @@ Local Test setup hbo.redis-provider.server_uri=redis://localhost:7001/ Production Setup ------------------------- +---------------- You can place the plugin JARs in the production's ``plugins`` directory. diff --git a/presto-docs/src/main/sphinx/release/release-0.248.1.rst b/presto-docs/src/main/sphinx/release/release-0.248.1.rst index ef69be85d4d3f..90a0a388b3103 100644 --- a/presto-docs/src/main/sphinx/release/release-0.248.1.rst +++ b/presto-docs/src/main/sphinx/release/release-0.248.1.rst @@ -3,5 +3,5 @@ Release 0.248.1 =============== General Changes ------------- +--------------- * Revert incorrect optimization introduced in :pr:`14915`. diff --git a/presto-docs/src/main/sphinx/release/release-0.248.rst b/presto-docs/src/main/sphinx/release/release-0.248.rst index a7059e72c0aff..71598b328a250 100644 --- a/presto-docs/src/main/sphinx/release/release-0.248.rst +++ b/presto-docs/src/main/sphinx/release/release-0.248.rst @@ -26,7 +26,7 @@ _______________ * Add configuration property ``internal-communication.https.trust-store-password`` to set the Java Truststore password used for https in internal communications between nodes. Hive Connector Changes -________________ +______________________ * Add session property ``temporary_table_create_empty_bucket_files`` and configuration property ``hive.create-empty-bucket-files-for-temporary-table``, which, when set to ``false``, disables the creation of zero-row files for temporary table empty buckets, to improve performance. Verifier Changes diff --git a/presto-docs/src/main/sphinx/release/release-0.258.rst b/presto-docs/src/main/sphinx/release/release-0.258.rst index 8eba756f8e443..6c52b40f410e3 100644 --- a/presto-docs/src/main/sphinx/release/release-0.258.rst +++ b/presto-docs/src/main/sphinx/release/release-0.258.rst @@ -27,7 +27,7 @@ ____________ * Add support for allowing to match columns between table and partition schemas by names for HUDI tables. This is enabled when configuration property ``hive.parquet.use-column-names`` or the hive catalog session property ``parquet_use_column_names`` is set to ``true``. By default they are mapped by index. Iceberg Changes -_________________________ +_______________ * Add support for ORC files. SPI Changes diff --git a/presto-docs/src/main/sphinx/release/release-0.261.rst b/presto-docs/src/main/sphinx/release/release-0.261.rst index 783d807c3fc53..b628ea082400a 100644 --- a/presto-docs/src/main/sphinx/release/release-0.261.rst +++ b/presto-docs/src/main/sphinx/release/release-0.261.rst @@ -38,7 +38,7 @@ ____________ * Add column comment to metadata in JDBC based connector. Prometheus Changes -____________ +__________________ * Fix startup error by reducing the default value of configuration property ``prometheus.query-chunk-duration`` from ``1d`` to ``10m``. **Credits** diff --git a/presto-docs/src/main/sphinx/release/release-0.264.rst b/presto-docs/src/main/sphinx/release/release-0.264.rst index 53bf2180094cb..35934ef7785fe 100644 --- a/presto-docs/src/main/sphinx/release/release-0.264.rst +++ b/presto-docs/src/main/sphinx/release/release-0.264.rst @@ -21,7 +21,7 @@ ____________ * Add session property ``hive.metastore_headers`` to allow the users to set headers that will be used in metastore operations. Iceberg Changes -____________ +_______________ * Add support in Iceberg connector for a native mode that can be used without a Hive installation, to run queries against Iceberg native catalogs. **Credits** diff --git a/presto-docs/src/main/sphinx/release/release-0.270.rst b/presto-docs/src/main/sphinx/release/release-0.270.rst index 6571107a90aab..b807394be17bc 100644 --- a/presto-docs/src/main/sphinx/release/release-0.270.rst +++ b/presto-docs/src/main/sphinx/release/release-0.270.rst @@ -18,15 +18,15 @@ _______________ * Add support for the following primitive types to Avro decoder: ``TINYINT``, ``SMALLINT``, ``INTEGER`` and ``REAL``. Hive Connector Changes -____________ +______________________ * Remove the configuration property ``hive.parquet.fail-on-corrupted-statistics`` and the session property ``parquet_fail_with_corrupted_statistics``. Iceberg Connector Changes -_______________ +_________________________ * Remove the configuration property ``iceberg.native-mode``. Use ``iceberg.catalog.type`` instead. Pinot Connector Changes -_____________ +_______________________ * Add support for Pinot ``TIMESTAMP`` and ``JSON`` types. * Add support for Pinot version 0.9.3. diff --git a/presto-docs/src/main/sphinx/release/release-0.272.rst b/presto-docs/src/main/sphinx/release/release-0.272.rst index 8e66956c3cfb9..a218392be5df6 100644 --- a/presto-docs/src/main/sphinx/release/release-0.272.rst +++ b/presto-docs/src/main/sphinx/release/release-0.272.rst @@ -16,8 +16,8 @@ _______________ This can be enabled by setting the session property ``execution_policy`` to ``phased`` and the stage count limit can be configured by the session property ``max_stage_count_for_eager_scheduling``. * Add :func:`secure_random()` function to return a cryptographically secure random number. -Hive Changes -____________ +Hive Connector Changes +______________________ * Fix integer overflow exception in Parquet writer when writing files larger than ~2 GB. * Add ability to do streaming aggregation for Hive table scans to improve query performance with aggregation when group-by keys are the same as order-by keys. Cases where group-by keys are a subset of order-by keys can't enable streaming aggregation for now. @@ -36,16 +36,16 @@ MongoDB Connector Changes _________________________ * Fix the spelling of the write concern option ``JOURNAL_SAFE`` for the property ``mongodb.write-concern``. -Iceberg Changes -_______________ +Iceberg Connector Changes +_________________________ * Add support for concurrent insertion from the same Presto cluster or multiple Presto clusters which share the same Metastore. -Pinot Changes -_____________ +Pinot Connector Changes +_______________________ * Add support for querying Pinot ``JSON`` type. Lark Sheets Connector Changes -_____________________ +_____________________________ * Add Lark Sheets connector. **Credits** diff --git a/presto-docs/src/main/sphinx/release/release-0.281.rst b/presto-docs/src/main/sphinx/release/release-0.281.rst index e698970073d09..7224d80c37d8d 100644 --- a/presto-docs/src/main/sphinx/release/release-0.281.rst +++ b/presto-docs/src/main/sphinx/release/release-0.281.rst @@ -38,13 +38,13 @@ ____________ * Enable Hive splits for uncompressed inputs in S3 Select connector by leveraging the scan range feature of the service. Apache Hudi Changes -____________ +___________________ * Add the asynchronous split generation in Hudi connector to speed up the query execution and reduce overall query finishing time. ``hudi.max-outstanding-splits`` session property controls the maximum outstanding splits in a batch enqueued for processing. ``hudi.split-generator-parallelism`` session property controls the number of threads to generate splits from partitions. * Upgrade Apache Hudi version to 0.12.1. Apache Iceberg Changes -_______________ +______________________ * Upgrade Apache Iceberg version from 1.1.0 to 1.2.0. JDBC Changes diff --git a/presto-docs/src/main/sphinx/release/release-0.282.rst b/presto-docs/src/main/sphinx/release/release-0.282.rst index a96dd5b062c2c..acc9aebc004d3 100644 --- a/presto-docs/src/main/sphinx/release/release-0.282.rst +++ b/presto-docs/src/main/sphinx/release/release-0.282.rst @@ -28,11 +28,11 @@ ____________ * Upgrade Alluxio version from 2.8.1 to 2.9.3. Apache Iceberg Changes -____________ +______________________ * Add parquet metadata caching in Apache Iceberg. Presto on Spark Changes -____________ +_______________________ * Add option to use ``selectAuthorizedIdentity`` API for Presto on Spark when ``permissions.authorized-identity-selection-enable`` set to ``true``. * Add an additional field ``attemptNumber`` in ``TaskId`` which is used to capture task retries in Presto on Spark. For presto classic this field will be set to ``0`` by default. * Remove :doc:`/sql/create-function` and :doc:`/sql/drop-function` support from Presto on Spark. diff --git a/presto-docs/src/main/sphinx/release/release-0.284.rst b/presto-docs/src/main/sphinx/release/release-0.284.rst index a6af803dc9a03..5a3a508007aaf 100644 --- a/presto-docs/src/main/sphinx/release/release-0.284.rst +++ b/presto-docs/src/main/sphinx/release/release-0.284.rst @@ -34,12 +34,12 @@ _______________ * Add ``noisy_count_if_gaussian(condition, noiseScale[, randomSeed])`` aggregation which calculates the number of ``TRUE`` input values, and then adds random Gaussian noise with 0 mean and standard deviation of ``noise_scale`` to the true count. Optional ``randomSeed`` is used to get a fixed value of noise, often for reproducibility purposes. If ``randomSeed`` is omitted, ``SecureRandom`` is used. If ``randomSeed`` is provided, ``Random`` is used. Hive Connector Changes -____________ +______________________ * Fix directory listing over directories with content-type ``application/octet-stream`` (:issue:`20310`). * Add DWRF filetype to min, max filtering for special column types such as tinyint, varbinary and timestamp. Iceberg Connector Changes -_______________ +_________________________ * Add Iceberg table location property in ``SHOW CREATE TABLE``. * Add validation for copy-on-write mode for Iceberg tables. This can be disabled with the ``merge_on_read_enabled`` session property or the ``iceberg.enable-merge-on-read-mode`` configuration property. * Add support for ``TRUNCATE TABLE ``. diff --git a/presto-docs/src/main/sphinx/release/release-0.287.rst b/presto-docs/src/main/sphinx/release/release-0.287.rst index f456d90cb2459..fe03aadad3d77 100644 --- a/presto-docs/src/main/sphinx/release/release-0.287.rst +++ b/presto-docs/src/main/sphinx/release/release-0.287.rst @@ -65,7 +65,7 @@ ___________ * Move `SortNode` to SPI module to be utilized in connector. :pr:`22497` Hive Connector Changes -____________ +______________________ * Fix a potential wrong results bug when footer stats are marked unreliable and partial aggregation pushdown is enabled. Such queries will now fail with an error. :pr:`22011` * Improve the ``hive.orc.use-column-names`` configuration setting to no longer fail on reading ORC files without column names, but fall back to using Hive's schema. This change improves compatibility with legacy ORC files. :pr:`21391` * Add session property ``hive.dynamic_split_sizes_enabled`` to use dynamic split sizes based on data selected by query. :pr:`22051` @@ -74,7 +74,7 @@ ____________ * Add system procedure ``system.invalidate_directory_list_cache()`` to invalidate directory list cache in Hive Catalog. :pr:`19821` Iceberg Connector Changes -_______________ +_________________________ * Upgrade Iceberg from 1.4.3 to 1.5.0. :pr:`21961` * Fix identity and truncate transforms on DecimalType columns. :pr:`21958` * Fix the bug that ``CAST`` from non-legacy timestamp to date rounding to future when the timestamp is prior than `1970-01-01 00:00:00.000`. :pr:`21959` @@ -87,7 +87,7 @@ _______________ * Add support for Iceberg concurrent insertions. :pr:`21250` MySQL Connector Changes -_____________ +_______________________ * Add support for timestamp column type. :pr:`21937` **Credits**