Apache Kafka and Azure connectors - hands-on workshop

Schedule

Prerequisites

• Bring your laptop.
• Azure account is not mandatory.
• Sign up for a free confluent cloud account before the day of the workshop. Use this link to signup - cnfl.io/apac-try-cloud
• Optional, but highly recommended: Install JDK and Confluent platform-tools from here: https://docs.confluent.io/platform/current/platform-quickstart.html#step-1-download-and-start-cp

Speakers

• Lakshmi Narasimhan
  Principal Engineer at Platformatory who always loves data engineering at its core. Currently working on different projects around ETL, and event streaming mainly around Apache Kafka - https://www.linkedin.com/in/lakshminp/
• Ashwin Venkatesan
  Senior Consultant at Platformatory working mainly on Apache Kafka and Kubernetes. Ashwin has done multiple projects building scalable data pipelines incorporating Apache Kafka in production scenarios. He also dabbles in Data science and Machine learning in his free time. His hobbies include traveling, cooking, and following Manchester United : )

Agenda

• What is Kafka & Confluent cloud?
• Difference between Kafka and a database, batch processing(Hadoop), and a message queue.
• Use case examples along with Questions & discussion about your problem statements.
• Other ways of running Kafka: docker/local, VMs, Kubernetes
• Authentication, Authorization.
• Integrating external systems with Kafka: Kafka Connect.
• Introduction to Kafka streams.
• Azure data connectors to Apache Kafka.
• Hands-on:
  • Producer and consumer.
  • KSQL.
  • Kafka components: brokers, zookeeper, schema registry.