This is our Camel CDC pipeline designed using EIPs.
|--> (format converter) --> [JSON queue]
[pgSQL] --> (Debezium endpoint) --> (type converter) --> (multicast) --|
|--> (format converter) --> [XML queue]We use the Debezium PostgreSQL Component as the endpoint which creates an event-driven consumer. This is a wrapper around Debezium embedded engine which enables CDC without the need to maintain Kafka clusters.
Compile and run the application.
mvn compile exec:java -f ./camel-cdc/pom.xmlProduce some more changes and check queues.
./run.sh streamThis is the Exchange created by Debezium component.
# body
Struct{
id=46,
first_name=500f5c4ad014caeaa6b196c268988e36,
last_name=9d074202a43901ed716d13c447a27d5a,
email=5b0c660d172b426e584c4ce92224d79b@example.com
}
# headers
{
CamelDebeziumBefore=null,
CamelDebeziumIdentifier=localhost.cdc.customers,
CamelDebeziumKey=Struct{id=46},
CamelDebeziumOperation=c,
CamelDebeziumSourceMetadata={
schema=cdc,
xmin=null,
connector=postgresql,
lsn=39610552,
name=localhost,
txId=2091,
version=1.1.0.Final,
ts_ms=1587226799511,
snapshot=false,
db=cdcdb,
table=customers
},
CamelDebeziumTimestamp=1587226809390
}