From 41074b0121114f4911805244eb67c2fd6e95e9aa Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Thu, 7 Aug 2025 04:15:35 +0200 Subject: [PATCH 1/2] Naming things: s/metrics/telemetry/ --- docs/integrate/index.md | 2 +- docs/integrate/{metrics => telemetry}/index.md | 3 ++- 2 files changed, 3 insertions(+), 2 deletions(-) rename docs/integrate/{metrics => telemetry}/index.md (91%) diff --git a/docs/integrate/index.md b/docs/integrate/index.md index 89370f83..464fee8d 100644 --- a/docs/integrate/index.md +++ b/docs/integrate/index.md @@ -17,7 +17,7 @@ Frameworks etl/index cdc/index mcp/index -Monitoring and Metrics +Metrics and Telemetry Data Visualization bi/index lineage/index diff --git a/docs/integrate/metrics/index.md b/docs/integrate/telemetry/index.md similarity index 91% rename from docs/integrate/metrics/index.md rename to docs/integrate/telemetry/index.md index 9549e106..0abcc156 100644 --- a/docs/integrate/metrics/index.md +++ b/docs/integrate/telemetry/index.md @@ -1,6 +1,7 @@ (metrics)= +(telemetry)= (integrate-metrics)= -# Monitoring and Metrics with CrateDB +# Store telemetry data in CrateDB CrateDB integrations with metrics collection agents, brokers, and stores. This documentation section lists applications and daemons which can From d02e55b827194ae41165d99bcbf4805499116272 Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Thu, 7 Aug 2025 04:17:35 +0200 Subject: [PATCH 2/2] Ingest: Add page about ingestion methods --- docs/index.md | 1 + docs/ingest/index.md | 68 +++++++++++++++++++++++++++++++ docs/integrate/telemetry/index.md | 2 +- 3 files changed, 70 insertions(+), 1 deletion(-) create mode 100644 docs/ingest/index.md diff --git a/docs/index.md b/docs/index.md index cbad059a..d8a8bbf9 100644 --- a/docs/index.md +++ b/docs/index.md @@ -307,6 +307,7 @@ use-cases. install/index connect/index getting-started +Ingestion feature/index admin/index performance/index diff --git a/docs/ingest/index.md b/docs/ingest/index.md new file mode 100644 index 00000000..c681e832 --- /dev/null +++ b/docs/ingest/index.md @@ -0,0 +1,68 @@ +(ingest)= +# CrateDB data ingestion + +:::{include} /_include/styles.html +::: + +All data ingestion methods for CrateDB at a glance. + +:::::{grid} 1 2 2 2 +:margin: 4 4 0 0 +:padding: 0 +:gutter: 2 + +::::{grid-item-card} {material-outlined}`file_upload;2em` Load data using CrateDB +- {ref}`Import files ` + + Load data from the local filesystem or from remote sources using CrateDB's + native `COPY FROM` SQL statement. + + **Protocols:** HTTP, FTP, Blob Storage (AWS S3, Azure) +
+ **Formats:** CSV, JSON Lines + +- {ref}`fdw` + + Make data in remote database servers available as tables within CrateDB. + You can then query these foreign tables like regular user tables. ++++ +Data import methods supported by CrateDB natively. +:::: + +::::{grid-item-card} {material-outlined}`cloud_upload;2em` Load data using CrateDB Cloud +- {ref}`Import files ` + + Managed data loading from remote sources using CrateDB Cloud's ETL subsystem. + + **Protocols:** HTTP, Blob Storage (AWS S3, Azure) +
+ **Formats:** CSV, JSON Lines, Parquet + +- {ref}`MongoDB CDC integration ` + + CrateDB Cloud enables continuous data ingestion from MongoDB using Change Data Capture + (CDC), providing seamless, real-time synchronization of your data. ++++ +Data import methods provided by CrateDB Cloud. +:::: + +::::{grid-item-card} {material-outlined}`arrow_circle_up;2em` Load data using external systems +- {ref}`Extract Transform Load (ETL) ` + + Ingest data with polyglot data integration platforms or libraries + and complete ETL solutions. + +- {ref}`cdc` + + Integrate with third-party change-data-capture (CDC) tools. + +- {ref}`telemetry` + + Ingest telemetry data—metrics, logs, and traces—from monitoring + and sensor collector systems. + ++++ +Supported industry-standard frameworks and paradigms. +:::: + +::::: diff --git a/docs/integrate/telemetry/index.md b/docs/integrate/telemetry/index.md index 0abcc156..2b2766ce 100644 --- a/docs/integrate/telemetry/index.md +++ b/docs/integrate/telemetry/index.md @@ -1,7 +1,7 @@ (metrics)= (telemetry)= (integrate-metrics)= -# Store telemetry data in CrateDB +# Telemetry data CrateDB integrations with metrics collection agents, brokers, and stores. This documentation section lists applications and daemons which can