Skip to content

Using Debezium with WarpStream as a Kafka alternative for CDC

License

Notifications You must be signed in to change notification settings

gordonmurray/warpstream_debezium

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CDC from MariaDB using Debezium and WarpStream

Trying out WarpStream as a Kafka alternative with Debezium.

Insecure connection

Make an insecure connection from Debezium to WarpStream using plain text

Secure connection

Make a secure connection from Debezium to WarpStream Serverless - using SASL

Apicurio Schema registry

Connect Debezium to WarpStream using Avro serialization and Apicurio schema registry

Sink data to S3 using Parquet format

Connect Debezium securely to WarpStream using Avro serialization and sink the data to S3 in Parquet format


In each folder, an example docker-compose.yml file is provided that launches a mariadb and a debezium container.

A connector can then submitted to Debezium which will tell it to read from Mariadb and push events to WarpStream.

Debezium and WarpStream

About

Using Debezium with WarpStream as a Kafka alternative for CDC

Topics

Resources

License

Stars

Watchers

Forks