Skip INIT_SYNC

[BhuviTheDataGuy]

We have done the historical data sync, so we want the Kafka connect to read from a particular timestamp period.

Is it possible? any example?

[anupamme]

Hi @BhuviTheDataGuy wondering whether you were able to figure this out?

It is specially relevant when the data stored in dynamo db is very large (billions of rows) and INIT_SYNC can possibly take days to complete as the record read throughput is bounded by 2000 events per second.

[anupamme]

I tried this:

kafka-avro-console-consumer --topic dynamodb-student --bootstrap-server localhost:9092

instead of

kafka-avro-console-consumer --topic dynamodb-test-dynamodb-connector --bootstrap-server localhost:9092 --from-beginning

And now it does not do init sync.