v3.2.1 anon, 351 ext, ivory4 and odoo

Highlights

• 351 PostgreSQL Extensions, including the powerful postgresql-anonymizer 2.0
• IvorySQL 4.0 support for EL 8/9
• Now use the Pigsty compiled Citus, TimescaleDB and pgroonga on all distros
• Add self-hosting Odoo template and support

New Install Method

Now you can install pigsty with pig cli tool:

curl -fsSL https://repo.pigsty.io/pig | bash
pig sty init     # install embed pigsty to ~/pigsty 
pig sty boot     # install ansible and other pre-deps 
pig sty conf     # auto-generate pigsty.yml config file
pig sty install  # run the install.yml playbook

Bump software versions

• pig CLI 0.1.2 self-updating capability
• prometheus 3.1.0

Add New Extension

• add pg_anon 2.0.0
• add omnisketch 1.0.2
• add ddsketch 1.0.1
• add pg_duration 1.0.1
• add ddl_historization 0.0.7
• add data_historization 1.1.0
• add schedoc 0.0.1
• add floatfile 1.3.1
• add pg_upless 0.0.3
• add pg_task 1.0.0
• add pg_readme 0.7.0
• add vasco 0.1.0
• add pg_xxhash 0.0.1

Update Extension

• lower_quantile 1.0.3
• quantile 1.1.8
• sequential_uuids 1.0.3
• pgmq 1.5.0 (subdir)
• floatvec 1.1.1
• pg_parquet 0.2.0
• wrappers 0.4.4
• pg_later 0.3.0
• topn fix for deb.arm64
• add age 17 on debian
• powa + pg17, 5.0.1
• h3 + pg17
• ogr_fdw + pg17
• age + pg17 1.5 on debian
• pgtap + pg17 1.3.3
• repmgr
• topn + pg17
• pg_partman 5.2.4
• credcheck 3.0
• ogr_fdw 1.1.5
• ddlx 0.29
• postgis 3.5.1
• tdigest 1.4.3
• pg_repack 1.5.2

What's Changed

• fix(supabase): use S3_REGION env var for storage s3 config by @washanhanzi in #485

New Contributors

• @washanhanzi made their first contribution in #485

Full Changelog: v3.2.0...v3.2.1

v3.2.0 the pig CLI, ARM, Supa & Grafana Enhancement

Get the pig CLI tool with

curl -fsSL https://repo.pigsty.io/pig | bash     # cloudflare, default 
curl -fsSL https://repo.pigsty.cc/pig | bash     # mainland china mirror

And install pigsty with pig sty sub command:

pig sty init     # install embed pigsty to ~/pigsty 
pig sty boot     # install ansible and other pre-deps 
pig sty conf     # auto-generate pigsty.yml config file
pig sty install  # run the install.yml playbook

Highlights

• New CLI: Introducing the pig command-line tool for managing extensions.
• ARM64 Support: 340 extensions are now available for ARM64 across five major Linux distro.
• Supabase Update: Latest Supabase Release Week updates are now supported for self-hosting on all distributions.
• Grafana v11.4: Upgraded Grafana to version 11.4, featuring a new Infinity datasource.

Package Changes

• New Extensions
  • Added timescaledb, timescaledb-loader, timescaledb-toolkit, and timescaledb-tool to the PIGSTY repository.
  • Added a custom-compiled pg_timescaledb for EL.
  • Added pgroonga, custom-compiled for all EL variants.
  • Added vchord 0.1.0.
  • Added pg_bestmatch.rs 0.0.1.
  • Added pglite_fusion 0.0.3.
  • Added pgpdf 0.1.0.
• Updated Extensions
  • pgvectorscale: 0.4.0 → 0.5.1
  • pg_parquet: 0.1.0 → 0.1.1
  • pg_polyline: 0.0.1
  • pg_cardano: 1.0.2 → 1.0.3
  • pg_vectorize: 0.20.0
  • pg_duckdb: 0.1.0 → 0.2.0
  • pg_search: 0.13.0 → 0.13.1
  • aggs_for_vecs: 1.3.1 → 1.3.2
• Infrastructure
  • Added promscale 0.17.0
  • Added grafana-plugins 11.4
  • Added grafana-infinity-plugins
  • Added grafana-victoriametrics-ds
  • Added grafana-victorialogs-ds
  • vip-manager: 2.8.0 → 3.0.0
  • vector: 0.42.0 → 0.43.0
  • grafana: 11.3 → 11.4
  • prometheus: 3.0.0 → 3.0.1 (package name changed from prometheus2 to prometheus)
  • nginx_exporter: 1.3.0 → 1.4.0
  • mongodb_exporter: 0.41.2 → 0.43.0
  • VictoriaMetrics: 1.106.1 → 1.107.0
  • VictoriaLogs: 1.0.0 → 1.3.2
  • pg_timetable: 5.9.0 → 5.10.0
  • tigerbeetle: 0.16.13 → 0.16.17
  • pg_export: 0.7.0 → 0.7.1
• New Docker App
  • Add mattermost the open-source Slack alternative self-hosting template
• Bug Fixes
  • Added python3-cdiff for el8.aarch64 to fix missing Patroni dependency.
  • Added timescaledb-tools for el9.aarch64 to fix missing package in official repo.
  • Added pg_filedump for el9.aarch64 to fix missing package in official repo.
  • Added citus support for el on aarch64
• Removed Extensions
  • pg_mooncake: Removed due to conflicts with pg_duckdb.
  • pg_top: Removed because of repeated version issues and quality concerns.
  • hunspell_pt_pt: Removed because of conflict with official PG dictionary files.
  • pgml: Disabled by default (no longer downloaded or installed).

API Changes

• repo_url_packages now defaults to an empty array; packages are installed via OS package managers.
• grafana_plugin_cache is deprecated; Grafana plugins are now installed via OS package managers.
• grafana_plugin_list is deprecated for the same reason.
• The 36-node “production” template has been renamed to simu.
• Auto-generated code under node_id/vars now includes aarch64 support.
• infra_packages now includes the pig CLI tool.
• The configure command now updates the version numbers of pgsql-xxx aliases in auto-generated config files.

Bug Fix

• Fix pgbouncer dashboard selector issue #474
• Add --arg value support for pg-pitr by @waitingsong
• Fix redis log message typo by @waitingsong

What's Changed

• fix: bin/redis log message typo by @waitingsong in #476
• fix: cpu count <4 by @waitingsong in #471
• update configuration references by @emmanuel-ferdman in #482

New Contributors

• @emmanuel-ferdman made their first contribution in #482

Full Changelog: v3.1.0...v3.2.0

Checksums

c42da231067f25104b71a065b4a50e68  pigsty-pkg-v3.2.0.d12.aarch64.tgz
ebb818f98f058f932b57d093d310f5c2  pigsty-pkg-v3.2.0.d12.x86_64.tgz
d2b85676235c9b9f2f8a0ad96c5b15fd  pigsty-pkg-v3.2.0.el9.aarch64.tgz
649f79e1d94ec1845931c73f663ae545  pigsty-pkg-v3.2.0.el9.x86_64.tgz
24c0be1d8436f3c64627c12f82665a17  pigsty-pkg-v3.2.0.u22.aarch64.tgz
0b9be0e137661e440cd4f171226d321d  pigsty-pkg-v3.2.0.u22.x86_64.tgz
8fdc6a60820909b0a2464b0e2b90a3a6  pigsty-v3.2.0.tgz

v3.1.0 Self-Hosting Supabase & MinIO, PG17, Arm64 & Ubuntu24

Pigsty v3.1 released 🎉 (2024-11-24)

curl -fsSL https://repo.pigsty.io/get | bash -s v3.1.0

Now you can self-hosting supabase with Pigsty

Features

• PostgreSQL 17 as the default major version (17.2)
• Ubuntu 24.04 noble support
• ARM64 support (el9, debian12, ubuntu 22.04)
• New playbook supabase.yml for quick self-hosting supabase
• MinIO Enhancement, best, practice, conf template, dashboards,...
• Allow using -v to specify PG major version during configure
• A series of out-of-the-box configuration templates and documentation.
• Now install the pgvector extension by default
• Simplify the repo packages configuration with package map alias
• Setup WiltonDB, IvorySQL, PolarDB repo mirror
• Enable postgres checksum by default

Software Upgrades

• PostgreSQL 17.2, 16.6, 15.10, 14.15, 13.18, 12.22
• PostgreSQL Extension Upgrades: https://ext.pigsty.io
• Prometheus: 2.54.0 -> 3.0.0
• VictoriaMetrics 1.102.1 -> 1.106.1
• VictoriaLogs v0.28.0 -> 1.0.0
• MySQL Exporter 0.15.1 -> 0.16.0
• Redis Exporter 1.62.0 -> 1.66.0
• MongoDB Exporter 0.41.2 -> 0.42.0
• Keepalived Exporter 1.3.3 -> 1.4.0
• DuckDB 1.1.2 -> 1.1.3
• etcd 3.5.16 -> 3.5.17
• tigerbeetle 16.8 -> 0.16.13

API Change

• repo_upstream: Now has defaults per distro: roles/node_id/vars
• repo_packages: Now support using package_map alias.
• repo_extra_packages: Now support missing default values, and using package_map alias.
• pg_checksum: Now the default value is true.
• pg_packages: Change to postgresql, wal2json pg_repack pgvector, patroni pgbouncer pgbackrest pg_exporter pgbadger vip-manager
• pg_extensions: Change to empty array []。
• infra_portal: Now allow using path in the home server

Full Changelog: v3.0.4...v3.1.0

Checksums

e62f9ce9f89a58958609da7b234bf2f2  pigsty-v3.1.0.tgz

v3.0.4 PG17 Extensions & Better Supabase

Features

• Build & Packaging applicable extensions for PostgreSQL 17
• Adding OLAP extensions: pg_duckdb & pg_parquet
• Better supabase self-hosting experience
• Allow pulling/load images after docker installation

Extensions

Check the new extension catalog: https://ext.pigsty.io

Statistics	All	PGDG	PIGSTY	MISC	MISS	PG17	PG16	PG15	PG14	PG13	PG12
EL Extension	338	134	130	4	7	298	334	336	328	319	310
Deb Extension	326	109	143	74	19	290	322	324	316	307	300
RPM Package	313	122	129	4	6	275	309	311	303	294	285
DEB Package	298	93	142	64	19	264	294	296	288	279	272

Upgrades

• New PG Extensions
  • pg_parquet
  • pg_explain_ui
  • pg_polyline
  • pg_cardano
  • pg_base58
  • pg_summarize
  • pg_relusage
  • pgmq
  • pg_timeseries
  • pg_plan_filter
• Bump Extension Version
  • pg_search 0.11.0
  • pg_analytics 0.2.0
  • plv8 3.2.3
  • supautils 2.5.0
  • icu_ext 1.9.0
  • redis_fdw 17
  • pg_failover_slots 1.1.0
  • pg_later 0.1.3
  • plprql 1.0.0
  • pg_vectorize 0.18.3
  • unit 7.7 -> 7.9
  • log_fdw 1.4
  • pg_duckdb 0.1.0
  • pg_graphql 1.5.9 (+17)
  • pg_jsonschema 0.3.2 (+17)
  • pgvectorscale 0.4.0 (+17)
  • wrappers 0.4.3 +pg17
  • pg_ivm 1.9
  • pg_timeseries 0.1.6
  • pgmq 1.4.4
  • pg_protobuf 16 17
  • pg_uuidv7 1.6
  • pg_readonly
  • pgddl 0.28
  • pg_safeupdate
  • pg_stat_monitor 2.1
  • pg_profile 4.7
  • system_stats 3.2
  • pg_auth_mon 3.0
  • login_hook 1.6
  • logerrors 2.1.3
  • pg-orphaned
  • pgnodemx 1.7
  • sslutils 1.4 (deb+pg16,17)
  • timestamp9 (deb)
• Fix broken extensions for PG16/17
  • pg_mon
  • pg_uri
  • agg_for_vecs
  • quantile
  • lower_quantile
  • pg_protobuf
  • acl
  • pg_emailaddr
  • pg_zstd
  • smlar
  • geohash
  • pgsmcrypto (+17)
  • pg_tiktoken (+17)
  • pg_idkit (+17)
• Update infra packages version
  • Grafana 11.3
  • duckdb 1.1.2
  • etcd 3.5.16
  • ferretdb 1.24.0
  • minio 20241013133411
  • mcli 2024101313411
  • pushgateway 1.10
  • tigerbeetle 0.16.8
  • mongodb_exporter 0.41.2
  • redis_exporter 1.64.1
  • vector 0.41.1
  • vip-manager 2.7
  • sealos 5.0.1

Checksums

5781f2c2f1a96912a9c656993b6299c4  pigsty-v3.0.4.tgz

Full Changelog: v3.0.3...v3.0.4

v3.0.3 PG 17, Etcd Enhancement

New Feature:

• PostgreSQL 17 support through config file
• WiltonDB 16, compatible with PG 16
• IvorySQL 3.4, sync with PostgreSQL 16.4
• ETCD alerting & monitoring enhancement

Version Upgrade:

• PostGIS 3.5
• Grafana 11.2
• duckdb 1.1
• pg_search 0.10.2
• pg_analytics 0.1.4

Full Changelog: v3.0.2...v3.0.3

v3.0.2 Mini Install & PolarDB 15

Features

• Minimal Installation support with pgsql-min.yml (NODE, PGSQL, ETCD only)
• Official support for the latest PolarDB for PostgreSQL Kernel v15
• Optimize monitor.pg_table_bloat and monitor.pg_index_bloat with security definer wrap functions to avoid PolarDB statistics view permission issue.
• Honor prometheus_enabled, grafana_enabled option in target register, not register when disabled.
• Add PGDATABASE and PGPORT environment variable to /etc/profile.d/pgsql.sh, set to pg_primary_db (default postgres)

Changes

• Remove PolarDB 11, CloudberryDB 1.5.4 packages from pgsql repo.
• New dedicate repo for PolarDB 15, CloudberryDB 1.6.0, MSSQL, IvorySQL.

Bug Fix

• Fix redis /etc/tmp.files.d entry name
• Set PGHOST and PGPORT when managing pgbouncer users.
• Remove support for pg_snakeoil due to clamv deps break on EL8
• Remove role pgsql notify handler for ansible 2.9 compatibility

Checksums

MD5 (pigsty-v3.0.2.tgz) = e366b754ec9b57f5e22c5feadd8f0901

v3.0.1: Oracle / Patroni4 / BugFix

v3.0.1 Released @ 2024-08-31

Features & Enhancement

• Oracle Compatibility through PolarDB-O (3rd commercial kernel)
• Rewrite monitoring views and SQL statements using Oracle-compatible SQL syntax
• Patroni 4 support and adaptation
• New extension pg_analytics enhances PostgreSQL with analytics capabilities via DuckDB
• Added new extensions: odbc_fdw and jdbc_fdw, providing universal external data source connectivity
• Added new kernel cloudberrydb (open-source fork by the original Greenplum developers)
• Add a restart after PGSQL primary initialization to apply pg_param & pg_files, no need to reboot after provisioning a Supabase PG / PolarDB cluster.
• Add new grafana plugin: volkovlabs-rss-datasource
• Add new dashboard panel: Extensions in PGCAT databases
• Bump Pev2 version to 1.12.1

Bug Fix

• Fix Grafana 11.1.4 panel plugin failed to load by default
• Fix BlackBox Exporter Ping probe failed on certain OS Distro (run as root rather than prometheus)
• Make sure /var/run/postgresql and /var/run/redis temporary directory always auto-create after reboot
• Fix cache.yml playbook not correctly remove outdated Patroni 3.0.4 RPM package
• Correct description errors in some alerting rules
• Remove outdated Bootstrap User/HBA parameters from Patroni configuration file

MD5 (pigsty-v3.0.1.tgz) = 277a05f8dc944b9b5ef99b682b300b8d
MD5 (pigsty-pkg-v3.0.1.d12.x86_64.tgz) = 6ca11ea3d3531f2d208fd7dd3b251234
MD5 (pigsty-pkg-v3.0.1.el8.x86_64.tgz) = 12aa6f2eaac46c907e544677ade1d81f
MD5 (pigsty-pkg-v3.0.1.el9.x86_64.tgz) = f1cc152e688ff94f984fb45b1ae28968
MD5 (pigsty-pkg-v3.0.1.u22.x86_64.tgz) = bad1ab8a54df467c46e7d750d92a56c1

Full Changelog: v3.0.0...v3.0.1

v3.0.0: Kernel, Extension, Service

Pigsty v3.0.0 Released (@2024-08-28)! Get started with:

curl -fsSL https://repo.pigsty.io/get | bash; cd ~/pigsty;
./bootstrap; ./configure; ./install.yml

Check the full Releasenote, and 中文版发行注记 for details

---

Highlight Features

Extension Exploding:

Pigsty now has unprecedented 333 available extensions for PostgreSQL. This includes 121 extension RPM packages and 133 DEB packages, surpassing the total number of extensions provided by the PGDG official repository (135 RPM/109 DEB).
Pigsty has ported unique PG extensions from the EL/DEB system to each other, achieving a great alignment of extension ecosystems between the two major distributions.

A crude list of the extension ecosystem is as follows:

- timescaledb periods temporal_tables emaj table_version pg_cron pg_later pg_background pg_timetable
- postgis pgrouting pointcloud pg_h3 q3c ogr_fdw geoip #pg_geohash #mobilitydb
- pgvector pgvectorscale pg_vectorize pg_similarity pg_tiktoken pgml #smlar
- pg_search pg_bigm zhparser hunspell
- hydra pg_lakehouse pg_duckdb duckdb_fdw pg_fkpart pg_partman plproxy #pg_strom citus
- pg_hint_plan age hll rum pg_graphql pg_jsonschema jsquery index_advisor hypopg imgsmlr pg_ivm pgmq pgq #rdkit
- pg_tle plv8 pllua plprql pldebugger plpgsql_check plprofiler plsh #pljava plr pgtap faker dbt2
- prefix semver pgunit md5hash asn1oid roaringbitmap pgfaceting pgsphere pg_country pg_currency pgmp numeral pg_rational pguint ip4r timestamp9 chkpass #pg_uri #pgemailaddr #acl #debversion #pg_rrule
- topn pg_gzip pg_http pg_net pg_html5_email_address pgsql_tweaks pg_extra_time pg_timeit count_distinct extra_window_functions first_last_agg tdigest aggs_for_arrays pg_arraymath pg_idkit pg_uuidv7 permuteseq pg_hashids
- sequential_uuids pg_math pg_random pg_base36 pg_base62 floatvec pg_financial pgjwt pg_hashlib shacrypt cryptint pg_ecdsa pgpcre icu_ext envvar url_encode #pg_zstd #aggs_for_vecs #quantile #lower_quantile #pgqr #pg_protobuf
- pg_repack pg_squeeze pg_dirtyread pgfincore pgdd ddlx pg_prioritize pg_checksums pg_readonly safeupdate pg_permissions pgautofailover pg_catcheck preprepare pgcozy pg_orphaned pg_crash pg_cheat_funcs pg_savior table_log pg_fio #pgpool pgagent
- pg_profile pg_show_plans pg_stat_kcache pg_stat_monitor pg_qualstats pg_store_plans pg_track_settings pg_wait_sampling system_stats pg_meta pgnodemx pg_sqlog bgw_replstatus pgmeminfo toastinfo pagevis powa pg_top #pg_statviz #pgexporter_ext #pg_mon
- passwordcheck supautils pgsodium pg_vault anonymizer pg_tde pgsmcrypto pgaudit pgauditlogtofile pg_auth_mon credcheck pgcryptokey pg_jobmon logerrors login_hook set_user pg_snakeoil pgextwlist pg_auditor noset #sslutils
- wrappers multicorn mysql_fdw tds_fdw sqlite_fdw pgbouncer_fdw mongo_fdw redis_fdw pg_redis_pubsub kafka_fdw hdfs_fdw firebird_fdw aws_s3 log_fdw #oracle_fdw #db2_fdw
- orafce pgtt session_variable pg_statement_rollback pg_dbms_metadata pg_dbms_lock pgmemcache #pg_dbms_job #wiltondb
- pglogical pgl_ddl_deploy pg_failover_slots wal2json wal2mongo decoderbufs decoder_raw mimeo pgcopydb pgloader pg_fact_loader pg_bulkload pg_comparator pgimportdoc pgexportdoc #repmgr #slony
- gis-stack rag-stack fdw-stack fts-stack etl-stack feat-stack olap-stack supa-stack stat-stack json-stack

Plugable Kernels:

Pigsty v3 allows you to replace the PostgreSQL kernel, currently supporting Babelfish (SQL Server compatible, with wire protocol emulation), IvorySQL (Oracle compatible), and RAC PolarDB for PostgreSQL.
Additionally, self-hosted Supabase is now available on Debian systems. You can emulate MSSQL (via WiltonDB), Oracle (via IvorySQL), Oracle RAC (via PolarDB), MongoDB (via FerretDB), and Firebase (via Supabase) in Pigsty
with production-grade PostgreSQL clusters featuring HA, IaC, PITR, and monitoring.

Pro Edition:

We now offer PGSTY Pro, a professional edition that provides value-added services on top of the open-source features.
The professional edition includes additional modules: MSSQL, Oracle, Mongo, K8S, Victoria, Kafka, etc., and offers broader support for PG major versions, operating systems, and chip architectures.
It provides offline installation packages customized for precise minor versions of all operating systems and support for legacy systems like EL7, Debian 11, and Ubuntu 20.04.

---

Major Changes

This Pigsty release updates the major version number from 2.x to 3.0, with several significant changes:

• Primary supported operating systems updated to: EL 8 / EL 9 / Debian 12 / Ubuntu 22.04
  • EL7 / Debian 11 / Ubuntu 20.04 systems are now deprecated and no longer supported.
  • Users needing to run on these systems should consider our subscription service.
• Default to online installation. Offline packages are no longer provided to resolve minor OS version compatibility issues.
  • The bootstrap process will no longer prompt for downloading offline packages, but if /tmp/pkg.tgz exists, it will still use the offline package automatically.
  • For offline installation, please create offline packages yourself or consider our subscription service.
• Unified adjustment of upstream software repositories used by Pigsty, address changes, and GPG signing and verification for all packages.
  • Standard repository: https://repo.pigsty.io/{apt/yum}
  • Domestic mirror: https://repo.pigsty.cc/{apt/yum}
• API parameter changes and configuration template changes
  • Configuration templates for EL and Debian systems are now consolidated, with differing parameters managed in the roles/node_id/vars/ directory.
  • Configuration directory changes, all configuration file templates are now placed in the conf directory and categorized into default, dbms, demo, build.
• Docker is now completely treated as a separate module and will not be downloaded by default
• New beta module: KAFKA
• New beta module: KUBE

---

Other New Features

• Epic enhancement of PG OLAP analysis capabilities: DuckDB 1.0.0, DuckDB FDW, and PG Lakehouse, Hydra have been ported to the Debian system.
• Strengthened PG vector search and full-text search capabilities: Vectorscale provides DiskANN vector indexing, Hunspell dictionary support, pg_search 0.8.6.
• Resolved package build issues for ParadeDB, now available on Debian/Ubuntu.
• All required extensions for Supabase are now available on Debian/Ubuntu, making Supabase self-hostable across all OSes.
• Provided capability for scenario-based pre-configured extension stacks. If you're unsure which extensions to install, we offer extension recommendation packages (Stacks) tailored for specific application scenarios.
• Created metadata tables, documentation, indexes, and name mappings for all PostgreSQL ecosystem extensions, ensuring alignment and usability for both EL and Debian systems.
• Enhanced proxy_env parameter functionality to mitigate DockerHub ban issues, simplifying configuration.
• Established a new dedicated software repository offering all extension plugins for versions 12-17, with the PG16 extension repository implemented by default in Pigsty.
• Upgraded existing software repositories, employing standard signing and verification mechanisms to ensure package integrity and security. The APT repository adopts a new standard layout built through reprepro.
• Provided sandbox environments for 1, 2, 3, 4, 43 nodes: meta, dual, trio, full, prod, and quick configuration templates for 7 major OS Distros.
• Add PostgreSQL 17 and pgBouncer 1.23 metrics support in pg_exporter config, adding related dashboard panels.
• Add logs panel for PGSQL Pgbouncer / PGSQL Patroni Dashboard
• Add new playbook cache.yml to make offline packages, instead of bash bin/cache and bin/release-pkg

---

API Changes

• New parameter option: pg_mode now has several new options:
  • pgsql: Standard PostgreSQL high availability cluster.
  • citus: Citus horizontally distributed PostgreSQL native high availability cluster.
  • gpsql: Monitoring for Greenplum and GP compatible databases (Pro edition).
  • mssql: Install WiltonDB / Babelfish to provide Microsoft SQL Server compatibility mode for standard PostgreSQL high availability clusters, with wire protocol level support, extensions unavailable.
  • ivory: Install IvorySQL to provide Oracle compatibility for PostgreSQL high availability clusters, supporting Oracle syntax/data types/functions/stored procedures, extensions unavailable (Pro edition).
  • polar: Install PolarDB for PostgreSQL (PG RAC) open-source version to support localization database capabilities, extensions unavailable (Pro edition).
• New parameter: pg_parameters, used to specify parameters in postgresql.auto.conf at the instance level, overriding cluster configurations for personalized settings on different instance members.
• New parameter: pg_files, used to specify additional files to be written to the PostgreSQL data directory, to support license feature required by some kernel forks.
• New parameter: repo_extra_packages, used to specify additional packages to download, to be used in conjunction with repo_packages, facilitating the specification of extension lists unique to OS versions.
• Parameter renaming: `patr...

v2.7.0: Extension Overwhelming

Get started with: bash -c "$(curl -fsSL https://get.pigsty.cc/install)"

Highlight

There are overall 255 extensions available in Pigsty now! check the extension list for details.

Adding numerous new extensions written in rust & pgrx:

• pg_search v0.7.0 : Full text search over SQL tables using the BM25 algorithm
• pg_lakehouse v0.7.0 : Query engine over object stores like S3 and table formats like Delta Lake
• pg_analytics v0.6.1 : Accelerates analytical query processing inside Postgres
• pg_graphql v1.5.4 : GraphQL support to your PostgreSQL database.
• pg_jsonschema v0.3.1 : PostgreSQL extension providing JSON Schema validation
• wrappers v0.3.1 : Postgres Foreign Data Wrappers Collections by Supabase
• pgmq v1.5.2 : A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.
• pg_tier v0.0.3 : Postgres Extension written in Rust, to enable data tiering to AWS S3
• pg_vectorize v0.15.0 : The simplest way to orchestrate vector search on Postgres
• pg_later v0.1.0 : Execute SQL now and get the results later.
• pg_idkit v0.2.3 : Generating many popular types of identifiers
• plprql v0.1.0 : Use PRQL in PostgreSQL
• pgsmcrypto v0.1.0 : PostgreSQL SM Algorithm Extension
• pg_tiktoken v0.0.1 : OpenAI tiktoken tokenizer for postgres
• pgdd v0.5.2 : Access Data Dictionary metadata with pure SQL

And some new extensions in plain C & C++

• parquet_s3_fdw 1.1.0 : ParquetS3 Foreign Data Wrapper for PostgresSQL
• plv8 3.2.2 : V8 Engine Javascript Procedural Language add-on for PostgreSQL
• md5hash 1.0.1 : Custom data type for storing MD5 hashes rather than text
• pg_tde 1.0 alpha: Experimental encrypted access method for PostgreSQL
• pg_dirtyread 2.6 : Read dead but unvacuumed tuples from a PostgreSQL relation
• New deb PGDG extensions: pg_roaringbitmap, pgfaceting, mobilitydb, pgsql-http, pg_hint_plan, pg_statviz, pg_rrule
• New rpm PGDG extensions: pg_profile, pg_show_plans
• Switch to PGDG's pgsql_http, pgsql_gzip, pg_net, pg_bigm instead of Pigsty RPM on EL distros.

New Features

• running on certain docker containers.
• prepare arm64 packages for infra & pgsql packages for el & deb distros.
• new installation script to download from cloudflare, and more hint.
• new monitoring dashboard for PGSQL PITR to assist the PITR procedure.
• make preparation for running pigsty inside docker VM containers
• add a fool-proof design for running pgsql.yml on node that is not managed by pigsty
• add config template for each major version: el7, el8, el9, debian11, debian12, ubuntu20, ubuntu22

Software Upgrade

• PostgreSQL 16.3
• Patroni 3.3.0
• pgBackRest 2.51
• vip-manager v2.5.0
• Haproxy 2.9.7
• Grafana 10.4.2
• Prometheus 2.51
• Loki & Promtail: 3.0.0 (breaking changes!)
• Alertmanager 0.27.0
• BlackBox Exporter 0.25.0
• Node Exporter 1.8.0
• pgBackrest Exporter 0.17.0
• duckdb 0.10.2
• etcd 3.5.13
• minio-20240510014138 / mcli-20240509170424
• pev2 v1.8.0 -> v1.11.0
• pgvector 0.6.1 -> 0.7.0
• pg_tle: v1.3.4 -> v1.4.0
• hydra: v1.1.1 -> v1.1.2
• duckdb_fdw: v1.1.0 recompile with libduckdb 0.10.2
• pg_bm25 0.5.6 -> pg_search 0.7.0
• pg_analytics: 0.5.6 -> 0.6.1
• pg_graphql: 1.5.0 -> 1.5.4
• pg_net 0.8.0 -> 0.9.1
• pg_sparse (deprecated)

Docker Application

• Odoo: launch open source ERP and plugins
• Jupyter: run jupyter notebook container
• PolarDB: run the demo PG RAC playground.
• supabase: bump to the latest GA version.
• bytebase: use the latest tag instead of ad hoc version.
• pg_exporter: update docker image example

Bug Fix

• Fix role pg_exporters white space in variable templates
• Fix minio_cluster not commented in global variables
• Fix the non-exist postgis34 in el7 config template
• Fix EL8 python3.11-cryptography deps to python3-cryptography according to upstream
• Fix /pg/bin/pg-role can not get OS user name from environ in non-interact mode
• Fix /pg/bin/pg-pitr can not hint -X -P flag properly

API Change

• New parameter node_write_etc_hosts to control whether to write /etc/hosts file on target nodes.
• Relocatable prometheus target directory with new parameter prometheus_sd_dir.
• Add -x|--proxy flag to enable and use value of global proxy env by @waitingsong in #405
• No longer parse infra nginx log details since it brings too much labels to the log.
• Use alertmanager API Version v2 instead of v1 in prometheus config.
• Use /pg/cert/ca.crt instead of /etc/pki/ca.crt in pgsql roles.

New Contributors

• @NeroSong made their first contribution in #373
• @waitingsong made their first contribution in #405

Package Checksums

Pigsty will provide offline packages for EL8, Debian 12 and Ubuntu 22.04.

0fe70a5306e8beaa1cf020084b48d0fb  pigsty-v2.7.0.tgz
ec271a1d34b2b1360f78bfa635986c3a  pigsty-pkg-v2.7.0.el8.x86_64.tgz
f3304bfd896b7e3234d81d8ff4b83577  pigsty-pkg-v2.7.0.debian12.x86_64.tgz
5b071c2a651e8d1e68fc02e7e922f2b3  pigsty-pkg-v2.7.0.ubuntu22.x86_64.tgz

You can still perform online installation on el7, el9, debian 11 and ubuntu 20.04

v2.6.0: PG 16, ParadeDB & DuckDB

Highlight

• Use PostgreSQL 16 as the default major version (16.2)
• Introduce ParadeDB extensions: pg_analytics, pg_bm25, and pg_sparse
• Introduce DuckDB and corresponding foreign data wrapper: duckdb_fdw
• Cloudflare CDN https://repo.pigsty.io and QCloud CDN https://repo.pigsty.cc

Configuration

• Disable Grafana Unified Alert to work around the "Database Locked" error。
• add node_repo_modules to add upstream repos (including local one) to node
• remove node_local_repo_urls, replaced by node_repo_modules & repo_upstream.
• remove node_repo_method, replaced by node_repo_modules.
• add the new local repo into repo_upstream instead of node_local_repo_urls
• add chrony into node_default_packages
• remove redis,minio,postgresql client from infra packages
• replace repo_upstream.baseurl $releasever on el8/el9 with major.minor version if applicable

Software Upgrade

• Grafana 10.3.3
• Prometheus 2.47
• node_exporter 1.7.0
• HAProxy 2.9.5
• Loki / Promtail 2.9.4
• minio-20240216110548 / mcli-20240217011557
• etcd 3.5.11
• Redis 7.2.4
• Bytebase 2.13.2
• HAProxy 2.9.5
• DuckDB 0.10.0
• FerretDB 1.19
• Metabase: new docker compose app template added

PostgreSQL x Pigsty Extensions

• PostgreSQL Minor Version Upgrade 16.2, 15.6, 14.11, 13.14, 12.18
• PostgreSQL 16 is now used as the default major version
• pg_exporter 0.6.1, security fix
• Patroni 3.2.2
• pgBadger 12.4
• pgBouncer 1.22
• pgBackRest 2.50
• vip-manager 2.3.0
• PostGIS 3.4.1
• PGVector 0.6.0
• TimescaleDB 2.14.1
• New Extension duckdb_fdw v1.1
• New Extension pgsql-gzip v1.0.0
• New Extension pg_sparse from ParadeDB: v0.5.6
• New Extension pg_bm25 from ParadeDB: v0.5.6
• New Extension pg_analytics from ParadeDB: v0.5.6
• Bump AI/ML Extension pgml to v2.8.1 with pg16 support
• Bump Columnar Extension hydra to v1.1.1 with pg16 support
• Bump Graph Extension age to v1.5.0 with pg16 support
• Bump Packaging Extension pg_tle to v1.3.4 with pg16 support
• Bump GraphQL Extension pg_graphql to v1.5.0 to support supabase

Checksums

6629431c07fd5df993ed8c68d7086b05  pigsty-v2.6.0.tgz
81abcd0ced798e1198740ab13317c29a  pigsty-pkg-v2.6.0.debian11.x86_64.tgz
7304f4458c9abd3a14245eaf72f4eeb4  pigsty-pkg-v2.6.0.debian12.x86_64.tgz
f914fbb12f90dffc4e29f183753736bb  pigsty-pkg-v2.6.0.el7.x86_64.tgz
fc23d122d0743d1c1cb871ca686449c0  pigsty-pkg-v2.6.0.el8.x86_64.tgz
9d258dbcecefd232f3a18bcce512b75e  pigsty-pkg-v2.6.0.el9.x86_64.tgz
901ee668621682f99799de8932fb716c  pigsty-pkg-v2.6.0.ubuntu20.x86_64.tgz
39872cf774c1fe22697c428be2fc2c22  pigsty-pkg-v2.6.0.ubuntu22.x86_64.tgz

What's Changed

• fix debian package url for bootstrap by @PMExtra in #354
• Changed local path to pg private key during pg_key_exists registration. by @Woblidog in #372

New Contributors

• @PMExtra made their first contribution in #354
• @Woblidog made their first contribution in #372

Full Changelog: v2.5.1...v2.6.0