Hands-on workshop on Apache Kafka and Confluent in partnership with Chennai Microsoft Azure User Group.
Schedule
| Name |
Speaker |
Start Time |
End Time |
Presentation |
Recording |
| Apache Kafka Workshop |
Lakshmi Narasimhan, Ashwin Venkatesan |
10:00 AM |
2:00 PM |
|
|
Prerequisites
- Bring your laptop.
- Azure account is not mandatory.
- Sign up for a free confluent cloud account before the day of the workshop. Use this link to signup - cnfl.io/apac-try-cloud
- Optional, but highly recommended: Install JDK and Confluent platform-tools from here: https://docs.confluent.io/platform/current/platform-quickstart.html#step-1-download-and-start-cp
Speakers
- Lakshmi Narasimhan
Principal Engineer at Platformatory who always loves data engineering at its core. Currently working on different projects around ETL, and event streaming mainly around Apache Kafka - https://www.linkedin.com/in/lakshminp/
- Ashwin Venkatesan
Senior Consultant at Platformatory working mainly on Apache Kafka and Kubernetes. Ashwin has done multiple projects building scalable data pipelines incorporating Apache Kafka in production scenarios. He also dabbles in Data science and Machine learning in his free time. His hobbies include traveling, cooking, and following Manchester United : )
Agenda
- What is Kafka & Confluent cloud?
- Difference between Kafka and a database, batch processing(Hadoop), and a message queue.
- Use case examples along with Questions & discussion about your problem statements.
- Other ways of running Kafka: docker/local, VMs, Kubernetes
- Authentication, Authorization.
- Integrating external systems with Kafka: Kafka Connect.
- Introduction to Kafka streams.
- Azure data connectors to Apache Kafka.
- Hands-on:
- Producer and consumer.
- KSQL.
- Kafka components: brokers, zookeeper, schema registry.
