Skip to content

Latest commit

 

History

History
643 lines (509 loc) · 47.2 KB

reference.adoc

File metadata and controls

643 lines (509 loc) · 47.2 KB

Debezium Operator Schema Reference

Condition Schema Reference

Table 1. Condition properties
Property Type Default Description

String

The status of the condition, either True, False or Unknown.

String

Human-readable message indicating details about the condition’s last transition.

String

Unique identifier of a condition.

ConfigMapOffsetStore Schema Reference

Used in: Offset

Table 2. ConfigMapOffsetStore properties
Property Type Default Description

String

Name of the offset config map

Map

Additional store configuration properties.

ContainerEnvVar Schema Reference

Table 3. ContainerEnvVar properties
Property Type Default Description

String

The environment variable name.

String

The environment variable value.

ContainerTemplate Schema Reference

Used in: Templates

Table 4. ContainerTemplate properties
Property Type Default Description

ResourceRequirements

CPU and memory resource requirements.

SecurityContext

Container security context.

Probes

Container probes configuration.

CustomStore Schema Reference

Used in: Offset, SchemaHistory

Table 5. CustomStore properties
Property Type Default Description

String

Fully qualified name of Java class implementing the store.

Map

Store configuration properties.

DataStorage Schema Reference

Used in: RuntimeStorage

Table 6. DataStorage properties
Property Type Default Description

ephemeral,persistent

ephemeral

Storage type.

String

Name of persistent volume claim for persistent storage.

DebeziumServer Schema Reference

Table 7. DebeziumServer properties
Property Type Default Description

DebeziumServerSpec

The specification of Debezium Server

DebeziumServerStatus

The status of Debezium

DebeziumServerSpec Schema Reference

Used in: DebeziumServer

Table 8. DebeziumServerSpec properties
Property Type Default Description

String

Image used for Debezium Server container. This property takes precedence over version.

String

same as operator

Version of Debezium Server to be used.

Sink

Sink configuration.

Source

Debezium source connector configuration.

Format

Message output format configuration.

Quarkus

Quarkus configuration passed down to Debezium Server process.

Runtime

Configuration allowing the modification of various aspects of Debezium Server runtime.

List<Transformation>

Single Message Transformations employed by this instance of Debezium Server.

Map<String, Predicate>

Predicates employed by this instance of Debezium Server.

DebeziumServerStatus Schema Reference

Used in: DebeziumServer

Table 9. DebeziumServerStatus properties
Property Type Default Description

List<Condition>

List of status conditions

Long

0L

Latest observed generation

FileOffsetStore Schema Reference

Used in: Offset

Table 10. FileOffsetStore properties
Property Type Default Description

String

Name of the offset file (relative to data root)

Map

Additional store configuration properties.

FileSchemaHistoryStore Schema Reference

Used in: SchemaHistory

Table 11. FileSchemaHistoryStore properties
Property Type Default Description

String

Name of the offset file (relative to data root)

Map

Additional store configuration properties.

Format Schema Reference

Table 12. Format properties
Property Type Default Description

key

FormatType

Message key format configuration.

FormatType

Message value format configuration.

FormatType

Message header format configuration.

FormatType Schema Reference

Used in: Format

Table 13. FormatType properties
Property Type Default Description

String

json

Format type recognised by Debezium Server.

Map

Format configuration properties.

InMemoryOffsetStore Schema Reference

Used in: Offset

Table 14. InMemoryOffsetStore properties
Property Type Default Description

Map

Additional store configuration properties.

InMemorySchemaHistoryStore Schema Reference

Used in: SchemaHistory

Table 15. InMemorySchemaHistoryStore properties
Property Type Default Description

Map

Additional store configuration properties.

JdbcOffsetStore Schema Reference

Used in: Offset

Table 16. JdbcOffsetStore properties
Property Type Default Description

JdbcOffsetTableConfig

The configuration of the offset table

url

String

JDBC connection URL

String

Username used to connect to the storage database

String

Password used to connect to the storage database

long

Retry delay on connection failure (in milliseconds)

int

Maximum number of retries on connection failure

Map

Additional store configuration properties.

JdbcOffsetTableConfig Schema Reference

Used in: JdbcOffsetStore

Table 17. JdbcOffsetTableConfig properties
Property Type Default Description

String

The name of the offset table

ddl

String

DDL statement to create the offset table

String

Statement used to select from the offset table

String

Statement used to insert into the offset table

String

Statement used to update the offset table

JdbcSchemaHistoryStore Schema Reference

Used in: SchemaHistory

Table 18. JdbcSchemaHistoryStore properties
Property Type Default Description

JdbcSchemaHistoryTableConfig

The configuration of the offset table

url

String

JDBC connection URL

String

Username used to connect to the storage database

String

Password used to connect to the storage database

long

Retry delay on connection failure (in milliseconds)

int

Maximum number of retries on connection failure

Map

Additional store configuration properties.

JdbcSchemaHistoryTableConfig Schema Reference

Table 19. JdbcSchemaHistoryTableConfig properties
Property Type Default Description

String

The name of the offset table

ddl

String

DDL statement to create the schema history table

String

Statement used to select from the schema history table

String

Statement used to insert into the schema history table

String

Statement used to check existence of some data in the schema history table

JmxAuthentication Schema Reference

Used in: JmxConfig

Table 20. JmxAuthentication properties
Property Type Default Description

boolean

false

Whether JMX authentication should be enabled for this Debezium Server instance.

String

Secret providing credential files

String

jmxremote.access

JMX access file name and secret key

String

jmxremote.password

JMX password file name and secret key

JmxConfig Schema Reference

Used in: Runtime

Table 21. JmxConfig properties
Property Type Default Description

boolean

false

Whether JMX should be enabled for this Debezium Server instance.

int

1099

JMX port.

JmxAuthentication

JMX authentication config.

JmxExporter Schema Reference

Used in: Metrics

Table 22. JmxExporter properties
Property Type Default Description

boolean

Enables JMX Prometheus exporter

ConfigMapKeySelector

Config map key reference which value will be used as configuration file

KafkaOffsetStore Schema Reference

Used in: Offset

Table 23. KafkaOffsetStore properties
Property Type Default Description

Map

Additional Kafka client properties.

String

A list of host/port pairs that the connector uses for establishing an initial connection to the Kafka cluster

String

The name of the Kafka topic where offsets are to be stored

int

The number of partitions used when creating the offset storage topic

int

Replication factor used when creating the offset storage topic

Map

Additional store configuration properties.

KafkaSchemaHistoryStore Schema Reference

Used in: SchemaHistory

Table 24. KafkaSchemaHistoryStore properties
Property Type Default Description

String

A list of host/port pairs that the connector uses for establishing an initial connection to the Kafka cluster

String

The name of the Kafka topic where offsets are to be stored

int

The number of partitions used when creating the offset storage topic

int

Replication factor used when creating the offset storage topic

Map

Additional store configuration properties.

MetadataTemplate Schema Reference

Used in: PodTemplate

Table 25. MetadataTemplate properties
Property Type Default Description

Map<String, String>

Labels added to the Kubernetes resource

Map<String, String>

Annotations added to the Kubernetes resource

Metrics Schema Reference

Used in: Runtime

Table 26. Metrics properties
Property Type Default Description

JmxExporter

Prometheus JMX exporter configuration

Offset Schema Reference

Used in: Source

Table 27. Offset properties
Property Type Default Description

FileOffsetStore

File backed offset store configuration

InMemoryOffsetStore

Memory backed offset store configuration

RedisOffsetStore

Redis backed offset store configuration

KafkaOffsetStore

Kafka backing store configuration

JdbcOffsetStore

JDBC backing store configuration

ConfigMapOffsetStore

Config map backed offset store configuration

CustomStore

Arbitrary offset store configuration

long

60000

Interval at which to try commiting offsets

PodTemplate Schema Reference

Used in: Templates

Table 28. PodTemplate properties
Property Type Default Description

MetadataTemplate

Metadata applied to the resource.

List<LocalObjectReference>

List of local references to secrets used for pulling any of the images used by this Pod.

Affinity

Pod affinity rules

PodSecurityContext

Pod-level security attributes and container settings

Predicate Schema Reference

Table 29. Predicate properties
Property Type Default Description

String

Fully qualified name of Java class implementing the predicate.

Map

Predicate configuration properties.

Probe Schema Reference

Used in: Probes

Table 30. Probe properties
Property Type Default Description

int

5

Number of seconds after the container has started before probes are initiated.

int

10

How often (in seconds) to perform the probe.

int

10

Number of seconds after which the probe times out.

int

3

Number of failures in a row before the overall check has failed.

Probes Schema Reference

Table 31. Probes properties
Property Type Default Description

Probe

Readiness probe configuration applied to the container.

Probe

Liveness probe configuration applied to the container.

Quarkus Schema Reference

Table 32. Quarkus properties
Property Type Default Description

Map

Quarkus configuration properties.

RedisOffsetStore Schema Reference

Used in: Offset

Table 33. RedisOffsetStore properties
Property Type Default Description

String

Redis host:port used to connect

String

Redis username

String

Redis password

boolean

false

Redis username

key

String

Redis hash key

RedisStoreWaitConfig

Configures verification of replica writes

Map

Additional store configuration properties.

RedisSchemaHistoryStore Schema Reference

Used in: SchemaHistory

Table 34. RedisSchemaHistoryStore properties
Property Type Default Description

String

Redis host:port used to connect

String

Redis username

String

Redis password

boolean

false

Redis username

key

String

Redis hash key

RedisStoreWaitConfig

Configures verification of replica writes

Map

Additional store configuration properties.

RedisStoreWaitConfig Schema Reference

Table 35. RedisStoreWaitConfig properties
Property Type Default Description

boolean

false

In case of Redis with replica, this allows to verify that the data has been written to replica

long

1000

Timeout in ms when waiting for replica

boolean

false

Enables retry on wait for replica

long

1000

Delay of retry on wait

Runtime Schema Reference

Table 36. Runtime properties
Property Type Default Description

api

RuntimeApi

API configuration

RuntimeStorage

Storage configuration

RuntimeEnvironment

Additional environment variables used by this Debezium Server.

jmx

JmxConfig

JMX configuration.

Templates

Debezium Server resource templates.

String

An existing service account used to run the Debezium Server pod

Metrics

Metrics configuration

RuntimeApi Schema Reference

Used in: Runtime

Table 37. RuntimeApi properties
Property Type Default Description

boolean

Whether the API should be enabled for this instance of Debezium Server

int

8080

Port number used by the k8s service exposing the API

RuntimeEnvironment Schema Reference

Used in: Runtime

Table 38. RuntimeEnvironment properties
Property Type Default Description

List<ContainerEnvVar>

Environment variables applied to the container.

List<EnvFromSource>

Additional environment variables set from ConfigMaps or Secrets in containers.

RuntimeStorage Schema Reference

Used in: Runtime

Table 39. RuntimeStorage properties
Property Type Default Description

DataStorage

File storage configuration used by this instance of Debezium Server.

List<Volume>

Additional volumes mounted to /debezium/external

SchemaHistory Schema Reference

Used in: Source

Table 40. SchemaHistory properties
Property Type Default Description

FileSchemaHistoryStore

File backed schema history store configuration

InMemorySchemaHistoryStore

Memory backed schema history store configuration

RedisSchemaHistoryStore

Redis backed schema history store configuration

KafkaSchemaHistoryStore

Kafka backed schema history store configuration

JdbcSchemaHistoryStore

JDBC backed schema history store configuration

CustomStore

Arbitrary schema history store configuration

Map

Additional common schema history store configuration properties.

Sink Schema Reference

Table 41. Sink properties
Property Type Default Description

String

Sink type recognised by Debezium Server.

Map

Sink configuration properties.

Source Schema Reference

Table 42. Source properties
Property Type Default Description

String

Fully qualified name of source connector Java class.

Offset

Offset store configuration

SchemaHistory

Schema history store configuration

Map

Source connector configuration properties.

Templates Schema Reference

Used in: Runtime

Table 43. Templates properties
Property Type Default Description

ContainerTemplate

Container template

pod

PodTemplate

Pod template.

PersistentVolumeClaimSpec

PVC template for data volume if no explicit claim is specified.

Transformation Schema Reference

Table 44. Transformation properties
Property Type Default Description

String

Fully qualified name of Java class implementing the transformation.

String

The name of the predicate to be applied to this transformation.

boolean

false

Determines if the result of the applied predicate will be negated.