Bangalore Streams meetup - June 2023

Schedule

Talks

• The State of Streaming & Modern Data

Speaker: Pavan Keshavamurthy, CTO & Co-founder @ Platformatory.io

About the talk: A navigator to the initiated and uninitiated into the world of streaming: Cover the breadth of drivers, reference architectures, blueprints and tooling within the Apache Fn ecosystem.

• Real time analytics and insights with Apache Kafka and Apache Pinot

Speaker: Suraj Pillai - Enterprise Architect at Startree, Saurabh Dubey Software Engineer at Startree

About the talk: Apache Pinot is a real-time, distributed, analytical data store which is widely used in the industry today for internal as well as user-facing analytical use cases. The columnar data format and variety of rich indexing strategies make it a perfect fit for running highly concurrent queries on multi-dimensional data within milliseconds. It has out-of-the-box support for Apache Kafka, HDFS, S3, Presto, and so on, and can seamlessly integrate with any big data stack. In this joint session we’ll be walking through Apache Pinot basics, Apache Pinot’s integration with Kafka as well as some use cases. We will also do a deep dive into the Join functionality available with Apache Pinot.

• Capturing database changes in real-time with Kafka Connect

Speaker: Chaitanya Mukka, Senior Software Engineer at Confluent

About the talk: This talk will explore the Kafka Connect ecosystem including its core concepts. We will be exploring a popular use case - the Change Data Capture (CDC) pattern - Basics, various architectures and live demo

• Unlocking Real-time Insights: CDC streams by the Lakehouse on Apache Hudi

Speaker: Sagar Sumit, Apache Committer and Software Engineer at Onehouse

About the talk: 1. The current challenges of processing CDC events at scale. 2. An overview of the internals of Apache Hudi. 3. How Hudi and Apache Kafka unlock incremental processing of CDC events on the lakehouse. 4. How Hudi manages data lifecycle through compaction and cleaning while simultaneously offering ACID semantics on the lake.

• Beyond Kafka: Exploring NATS for Modern Event-Driven Architectures

Speaker: Robin Biju Thomas, Technical Architect

About the talk: In this talk, we will delve into the world of modern event-driven architectures and explore how NATS can be a compelling alternative to Kafka. We will discuss the key features, benefits, and use cases of NATS, highlighting its strengths in building scalable, efficient, and resilient event-driven systems.

Speakers

• Pavan Keshavamurthy
  CTO & Co-founder @ Platformatory.io
• Chaitanya Mukka
  Chaitanya is a Senior Software Engineer at Confluent and has been working with the Kafka Connect team for the past 3 years. Chaitanya has worked on developing several connectors as well as improving monitoring and security of Connect on Confluent Cloud. He also has a background in theoretical mathematics and is always in search of problems in software that need formal definitions and novel solutions. He is excited about data, distributed systems and cloud-native solutions.
• Sagar Sumit
  I am an Apache Committer and a Software Engineer at Onehouse, a fully-managed lakehouse platform. My primary contributions are to Apache Hudi’s core transactional engine and its integration with different query engines such as Presto and Trino.
• Robin Biju Thomas
  I’m a Technical Architect from an IoT SaaS background, passionate about finding simple solutions to complex problems. I am but a passionately curious engineer by heart and soul. In pursuit of this curiosity, I have been exposed to a wide range of domains, platforms and technologies. As any driven engineer can relate, We are problem solvers. I enjoy applying myself to find simple solutions to complex problems while trying to stay outcome driven.
• Suraj Pillai
  Enterprise Architect in Sales, StarTree India
• Saurabh Dubey
  Software Engineer in Engineering, StarTree India