Demonstration of the use of technologies related to data streaming processing.
- Apache Kafka
- Confluent Platform
- Debezium Connector
- Kafka Connect Datagen
- Elasticsearch Sink Connector
- Kafka Streams
- KsqlDB
- MySQL
- Elastic
- Install Confluent Platform
- Create the MySQL database and tables according to the script: mysql-rosetta-setup.sql
foo@bar:~$ ./setup-demo-customers
foo@bar:~$ ./setup-demo-customers ksql
foo@bar:~$ ./setup-demo-calls.sh
foo@bar:~$ ./setup-demo-calls.sh ksql
foo@bar:~$ ./setup-demo-calls-customers.sh
You can check the result with:
foo@bar:~$ kafka-avro-console-consumer --bootstrap-server localhost:9092 --topic CALLS_CLIENTES_ENR --from-beginning