Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/connector/cassandra.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ ScyllaDB uses the same port as Cassandra by default.
Just point to ScyllaDB nodes in ``cassandra.contact-points`` config property.

Multiple Cassandra or ScyllaDB Clusters
^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

You can have as many catalogs as you need, so if you have additional
Cassandra(ScyllaDB) clusters, simply add another properties file to ``etc/catalog``
Expand Down Expand Up @@ -161,7 +161,7 @@ Property Name Description
============================================================= ======================================================================

Querying Cassandra or ScyllaDB Tables
-------------------------
-------------------------------------

The ``users`` table is an example Cassandra table from the Cassandra
`Getting Started`_ guide. It can be created along with the ``mykeyspace``
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/connector/hive.rst
Original file line number Diff line number Diff line change
Expand Up @@ -658,7 +658,7 @@ This query will collect statistics for 2 partitions with keys:
* ``partition2_value1, partition2_value2``

Quick Stats
--------------------------------------
-----------

The Hive connector can build basic statistics for partitions with missing statistics
by examining file or table metadata. For example, Parquet footers can be used to infer
Expand Down Expand Up @@ -874,7 +874,7 @@ columns as a part of the query like any other columns of the table.
* ``$file_modified_time`` : Last file modified time for the given row (int64_t), in milliseconds since January 1, 1970 UTC

How to invalidate metastore cache?
---------------------------------
----------------------------------

The Hive connector exposes a procedure over JMX (``com.facebook.presto.hive.metastore.CachingHiveMetastore#flushCache``) to invalidate the metastore cache.
You can call this procedure to invalidate the metastore cache by connecting via jconsole or jmxterm.
Expand Down
6 changes: 3 additions & 3 deletions presto-docs/src/main/sphinx/connector/hudi.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
====================
Hudi connector
====================
==============
Hudi Connector
==============

Overview
--------
Expand Down
8 changes: 4 additions & 4 deletions presto-docs/src/main/sphinx/connector/singlestore.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
===============
=====================
SingleStore Connector
===============
=====================

The SingleStore connector allows querying and creating tables in an external
SingleStore database. This can be used to join data between different
Expand Down Expand Up @@ -66,9 +66,9 @@ If you used a different name for your catalog properties file, use
that catalog name instead of ``singlestore`` in the above examples.

SingleStore Connector Limitations
---------------------------
---------------------------------

The following SQL statements are not yet supported:
The following SQL statements are not supported:

* :doc:`/sql/create-table` with ``rowstore`` table type (supports only ``columnstore`` table type, set by default `docs <https://docs.singlestore.com/cloud/reference/sql-reference/data-definition-language-ddl/create-table/>`_.)
* :doc:`/sql/alter-schema`
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/connector/sqlserver.rst
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ connection properties as appropriate for your setup:


Connection security
------------------
-------------------

The JDBC driver and connector automatically use Transport Layer Security (TLS) encryption and certificate validation. This requires a suitable TLS certificate configured on your SQL Server database host.

Expand Down Expand Up @@ -75,7 +75,7 @@ if you name the property file ``sales.properties``, Presto will create a
catalog named ``sales`` using the configured connector.

General Configuration Properties
---------------------------------
--------------------------------

================================================== ==================================================================== ===========
Property Name Description Default
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/ecosystem.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
*****
*********
Ecosystem
*****
*********

.. toctree::
:maxdepth: 1
Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/functions/comparison.rst
Original file line number Diff line number Diff line change
Expand Up @@ -238,7 +238,7 @@ Example::


Row comparison: NOT IN
------------------
----------------------

The NOT IN comparison operator in SQL is used to exclude the rows that match any value in a list or subquery.

Expand Down
6 changes: 3 additions & 3 deletions presto-docs/src/main/sphinx/functions/math.rst
Original file line number Diff line number Diff line change
Expand Up @@ -172,7 +172,7 @@ Mathematical Functions
assumed to be in sorted ascending order.

Probability Functions: cdf
-----------------------
--------------------------

.. function:: beta_cdf(a, b, value) -> double

Expand Down Expand Up @@ -230,7 +230,7 @@ Probability Functions: cdf


Probability Functions: inverse_cdf
-----------------------
----------------------------------

.. function:: inverse_beta_cdf(a, b, p) -> double

Expand Down Expand Up @@ -297,7 +297,7 @@ Probability Functions: inverse_cdf


Statistical Functions
-----------------------
---------------------

.. function:: wilson_interval_lower(successes, trials, z) -> double

Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/overview/concepts.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ There are three types of Presto servers: resource manager, coordinators and work
following section explains the difference between them.

Resource Manager
^^^^^^^^^^^
^^^^^^^^^^^^^^^^

The Presto resource manager is the server that aggregates
data from all coordinators and workers and constructs a global view of the cluster.
Expand Down
10 changes: 5 additions & 5 deletions presto-docs/src/main/sphinx/plugin/redis-hbo-provider.rst
Original file line number Diff line number Diff line change
Expand Up @@ -32,8 +32,8 @@ Property Name Description
``hbo.redis-provider.cluster-mode-enabled`` Boolean property whether cluster mode is enabled
============================================ =====================================================================

Coordinator Configuration for Historical Based Optimization:
------------------------
Coordinator Configuration for Historical Based Optimization
-----------------------------------------------------------

These properties must be configured on the Presto coordinator in ``etc/config.properties`` for tracking and using historical statistics in planning:

Expand All @@ -54,8 +54,8 @@ Credentials
The plugin requires the Redis Server URI property ``hbo.redis-provider.server_uri`` to access Redis.
Based on your custom Redis deployment, you may need to add additional credentials.

Local Test setup
------------------------
Local Test Setup
----------------

1. Set up a local Redis cluster following the Redis documentation to `Create a Redis Cluster <https://redis.io/docs/management/scaling/#create-a-redis-cluster>`_.

Expand All @@ -74,7 +74,7 @@ Local Test setup
hbo.redis-provider.server_uri=redis://localhost:7001/

Production Setup
------------------------
----------------

You can place the plugin JARs in the production's ``plugins`` directory.

Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/release/release-0.248.1.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3,5 +3,5 @@ Release 0.248.1
===============

General Changes
------------
---------------
* Revert incorrect optimization introduced in :pr:`14915`.
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/release/release-0.248.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ _______________
* Add configuration property ``internal-communication.https.trust-store-password`` to set the Java Truststore password used for https in internal communications between nodes.

Hive Connector Changes
________________
______________________
* Add session property ``temporary_table_create_empty_bucket_files`` and configuration property ``hive.create-empty-bucket-files-for-temporary-table``, which, when set to ``false``, disables the creation of zero-row files for temporary table empty buckets, to improve performance.

Verifier Changes
Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/release/release-0.258.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ ____________
* Add support for allowing to match columns between table and partition schemas by names for HUDI tables. This is enabled when configuration property ``hive.parquet.use-column-names`` or the hive catalog session property ``parquet_use_column_names`` is set to ``true``. By default they are mapped by index.

Iceberg Changes
_________________________
_______________
* Add support for ORC files.

SPI Changes
Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/release/release-0.261.rst
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ ____________
* Add column comment to metadata in JDBC based connector.

Prometheus Changes
____________
__________________
* Fix startup error by reducing the default value of configuration property ``prometheus.query-chunk-duration`` from ``1d`` to ``10m``.

**Credits**
Expand Down
2 changes: 1 addition & 1 deletion presto-docs/src/main/sphinx/release/release-0.264.rst
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ ____________
* Add session property ``hive.metastore_headers`` to allow the users to set headers that will be used in metastore operations.

Iceberg Changes
____________
_______________
* Add support in Iceberg connector for a native mode that can be used without a Hive installation, to run queries against Iceberg native catalogs.

**Credits**
Expand Down
6 changes: 3 additions & 3 deletions presto-docs/src/main/sphinx/release/release-0.270.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,15 +18,15 @@ _______________
* Add support for the following primitive types to Avro decoder: ``TINYINT``, ``SMALLINT``, ``INTEGER`` and ``REAL``.

Hive Connector Changes
____________
______________________
* Remove the configuration property ``hive.parquet.fail-on-corrupted-statistics`` and the session property ``parquet_fail_with_corrupted_statistics``.

Iceberg Connector Changes
_______________
_________________________
* Remove the configuration property ``iceberg.native-mode``. Use ``iceberg.catalog.type`` instead.

Pinot Connector Changes
_____________
_______________________
* Add support for Pinot ``TIMESTAMP`` and ``JSON`` types.
* Add support for Pinot version 0.9.3.

Expand Down
14 changes: 7 additions & 7 deletions presto-docs/src/main/sphinx/release/release-0.272.rst
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ _______________
This can be enabled by setting the session property ``execution_policy`` to ``phased`` and the stage count limit can be configured by the session property ``max_stage_count_for_eager_scheduling``.
* Add :func:`secure_random()` function to return a cryptographically secure random number.

Hive Changes
____________
Hive Connector Changes
______________________
* Fix integer overflow exception in Parquet writer when writing files larger than ~2 GB.
* Add ability to do streaming aggregation for Hive table scans to improve query performance with aggregation when group-by keys are the same as order-by keys.
Cases where group-by keys are a subset of order-by keys can't enable streaming aggregation for now.
Expand All @@ -36,16 +36,16 @@ MongoDB Connector Changes
_________________________
* Fix the spelling of the write concern option ``JOURNAL_SAFE`` for the property ``mongodb.write-concern``.

Iceberg Changes
_______________
Iceberg Connector Changes
_________________________
* Add support for concurrent insertion from the same Presto cluster or multiple Presto clusters which share the same Metastore.

Pinot Changes
_____________
Pinot Connector Changes
_______________________
* Add support for querying Pinot ``JSON`` type.

Lark Sheets Connector Changes
_____________________
_____________________________
* Add Lark Sheets connector.

**Credits**
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/release/release-0.281.rst
Original file line number Diff line number Diff line change
Expand Up @@ -38,13 +38,13 @@ ____________
* Enable Hive splits for uncompressed inputs in S3 Select connector by leveraging the scan range feature of the service.

Apache Hudi Changes
____________
___________________
* Add the asynchronous split generation in Hudi connector to speed up the query execution and reduce overall query finishing time. ``hudi.max-outstanding-splits`` session property controls the maximum outstanding splits in a batch enqueued for processing. ``hudi.split-generator-parallelism`` session property controls the number of threads to generate splits from partitions.
* Upgrade Apache Hudi version to 0.12.1.


Apache Iceberg Changes
_______________
______________________
* Upgrade Apache Iceberg version from 1.1.0 to 1.2.0.

JDBC Changes
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/release/release-0.282.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,11 +28,11 @@ ____________
* Upgrade Alluxio version from 2.8.1 to 2.9.3.

Apache Iceberg Changes
____________
______________________
* Add parquet metadata caching in Apache Iceberg.

Presto on Spark Changes
____________
_______________________
* Add option to use ``selectAuthorizedIdentity`` API for Presto on Spark when ``permissions.authorized-identity-selection-enable`` set to ``true``.
* Add an additional field ``attemptNumber`` in ``TaskId`` which is used to capture task retries in Presto on Spark. For presto classic this field will be set to ``0`` by default.
* Remove :doc:`/sql/create-function` and :doc:`/sql/drop-function` support from Presto on Spark.
Expand Down
4 changes: 2 additions & 2 deletions presto-docs/src/main/sphinx/release/release-0.284.rst
Original file line number Diff line number Diff line change
Expand Up @@ -34,12 +34,12 @@ _______________
* Add ``noisy_count_if_gaussian(condition, noiseScale[, randomSeed])`` aggregation which calculates the number of ``TRUE`` input values, and then adds random Gaussian noise with 0 mean and standard deviation of ``noise_scale`` to the true count. Optional ``randomSeed`` is used to get a fixed value of noise, often for reproducibility purposes. If ``randomSeed`` is omitted, ``SecureRandom`` is used. If ``randomSeed`` is provided, ``Random`` is used.

Hive Connector Changes
____________
______________________
* Fix directory listing over directories with content-type ``application/octet-stream`` (:issue:`20310`).
* Add DWRF filetype to min, max filtering for special column types such as tinyint, varbinary and timestamp.

Iceberg Connector Changes
_______________
_________________________
* Add Iceberg table location property in ``SHOW CREATE TABLE``.
* Add validation for copy-on-write mode for Iceberg tables. This can be disabled with the ``merge_on_read_enabled`` session property or the ``iceberg.enable-merge-on-read-mode`` configuration property.
* Add support for ``TRUNCATE TABLE <table>``.
Expand Down
6 changes: 3 additions & 3 deletions presto-docs/src/main/sphinx/release/release-0.287.rst
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ ___________
* Move `SortNode` to SPI module to be utilized in connector. :pr:`22497`

Hive Connector Changes
____________
______________________
* Fix a potential wrong results bug when footer stats are marked unreliable and partial aggregation pushdown is enabled. Such queries will now fail with an error. :pr:`22011`
* Improve the ``hive.orc.use-column-names`` configuration setting to no longer fail on reading ORC files without column names, but fall back to using Hive's schema. This change improves compatibility with legacy ORC files. :pr:`21391`
* Add session property ``hive.dynamic_split_sizes_enabled`` to use dynamic split sizes based on data selected by query. :pr:`22051`
Expand All @@ -74,7 +74,7 @@ ____________
* Add system procedure ``system.invalidate_directory_list_cache()`` to invalidate directory list cache in Hive Catalog. :pr:`19821`

Iceberg Connector Changes
_______________
_________________________
* Upgrade Iceberg from 1.4.3 to 1.5.0. :pr:`21961`
* Fix identity and truncate transforms on DecimalType columns. :pr:`21958`
* Fix the bug that ``CAST`` from non-legacy timestamp to date rounding to future when the timestamp is prior than `1970-01-01 00:00:00.000`. :pr:`21959`
Expand All @@ -87,7 +87,7 @@ _______________
* Add support for Iceberg concurrent insertions. :pr:`21250`

MySQL Connector Changes
_____________
_______________________
* Add support for timestamp column type. :pr:`21937`

**Credits**
Expand Down