Skip to content

Latest commit

 

History

History
77 lines (51 loc) · 2.16 KB

RTA-Summit-Workshop.adoc

File metadata and controls

77 lines (51 loc) · 2.16 KB

Training Outline and Timeline

Welcome Breakfast

Duration 7:30 AM - 9:00 AM

  • Participants arrive and enjoy breakfast

  • Time for networking and setting up personal workstations, PC laptop uses are finding power sources

Module 1: Introduction to Real-Time Analytics and Overview of Technologies

Duration: 1 hr (9:00 AM - 10:00 AM) Speaker: Viktor

  • Discuss the concept of real-time analytics

  • Overview of Apache Kafka, Apache Flink, and Apache Pinot

  • How these technologies work together in a real-time analytics stack

Module 2: Setting Up Local Clusters with Docker

Duration: 30 min (10:00 AM - 10:30 AM) Speakers: Viktor (Lead), Upkar (TA)

  • Guide on installing Docker (if not pre-installed)

  • Setup of Apache Kafka, Apache Flink, and Apache Pinot clusters

    • checking internet connection

    • pulling images

    • smoke test

  • Ensuring everyone’s local environment is configured correctly

Break

Duration: 30 min (10:30 AM - 11:00 AM)

Module 3: Ingesting Data into Apache Pinot

Duration 1hr (11:00 AM - 12:00 PM) Speaker: Viktor

  • Creating a schema and configuring a table in Pinot

  • Ingesting static data into an offline table

  • Querying data in Apache Pinot

Lunch Break 12:00 PM - 1:00 PM

Module 4: Integrating Kafka with Pinot for Real-Time Data Ingestion

Duration: 1 hr (1:00 PM - 2:00 PM) Speaker: Viktor (Lead), Upkar (TA)

  • Kafka 101 refresher

  • Setting up a Kafka topic

  • Streaming data ingestion from Kafka to a real-time table in Pinot

  • Using the Pinot UI to monitor and manage the cluster

Break 2:00 PM - 2:30 PM

Module 5: Stream Processing with Apache Flink

Duration: 1hr (2:30 PM - 3:30 PM) Speakers: Upkar (Lead), Viktor (TA)

  • Basic concepts of stream processing

  • Implementing stream processing tasks with Apache Flink

  • Enriching Kafka streams before ingestion into Pinot

Wrap-Up and Q&A

Duration: 30 min (3:30 PM - 4:00 PM) Speakers: Viktor, Upkar

  • Recap of the day’s lessons

  • Open floor for questions

  • Discussion on potential use cases in participants' work

Equipment and Software Check

  • Ensure all participants have installed Docker Desktop and have the necessary system resources as outlined in the prerequisites.