Bangalore Streams meetup - April 2024
Saturday 20 Apr 2024 9:30am - 2:30pm
Venue
Address
We're excited to continue our new series of events in Bengaluru focused on data streaming and adjacent technologies. Our objective is to share knowledge and provide a platform for thought leadership around:
Event Streaming Technologies (Apache Kafka and more)
Event Driven Architecture
Stream Processing
Streaming Databases
Real-time analytics
Data Mesh
..and more.
We're hosting our next in-person event on April 20. Join us for exciting discussions in the streaming world with opportunities to network with peers and leaders in the industry.
Schedule
| Name | Speaker | Start Time | End Time | Presentation | Recording |
|---|---|---|---|---|---|
| Welcome and registration | 10:00 AM | 10:20 AM | |||
| Optimizing Real-Time Analytics: Strategies for Optimizing high concurrency real time analytics using Apache Kafka and Apache Druid | Tijo Thomas, Imply | 10:30 AM | 11:15 AM | Slides | YouTube |
| Mq (Queuing Abstraction at Meesho for Scalable and Efficient Communication) | Ramiz Mehran, Meesho | 11:20 AM | 12:00 PM | YouTube | |
| Networking break | 12:00 PM | 12:15 PM | |||
| Solving for Real-time in modern ecommerce: A primer on challenges, opportunities and solutions | Ashwin Venkatesan, Platformatory.io | 12:15 PM | 01:00 PM | Slides | YouTube |
| Lunch and Networking | 01:00 PM | 02:30 PM |
Talks
- Optimizing Real-Time Analytics: Strategies for Optimizing high concurrency real time analytics using Apache Kafka and Apache Druid
Speaker: Tijo Thomas, Manager, Solutions Architect @ Imply
About the talk: We will delve into Apache Druid’s capabilities as a real-time analytical database optimized for event-driven data and large-scale queries. We will discuss Druid’s data storage and indexing strategies, which allow for fast data ingestion and query responses, essential for real-time analytics.
The core of the talk will focus on tuning and optimization strategies for both Kafka and Druid. This includes configuring Kafka producers and consumers for maximum efficiency, understanding and applying Druid’s indexing schemes, and tuning Druid’s query performance. We will also discuss how to effectively manage and scale the Kafka-Druid pipeline to handle increasing volumes of data.
- Mq (Queuing Abstraction at Meesho for Scalable and Efficient Communication)
Speaker: Ramiz Mehran, Software Architect at Meesho
About the talk: We’ll explore the challenges of tightly coupled messaging queues and the financial and operational inefficiencies they introduce, such as over-provisioning and migration headaches. We’ll introduce MQ Abstraction as a solution that decouples application code from specific messaging infrastructures, enabling seamless interaction and standardizing configurations for optimal performance. Through a quick overview of its architecture and benefits, we’ll discuss how MQ Abstraction simplifies messaging queue interactions, promotes scalability, and reduces costs.
- Solving for Real-time in modern ecommerce: A primer on challenges, opportunities and solutions
Speaker: Ashwin Venkatesan, Platform Engineer @ Platformatory.io
About the talk: Customer experience is the real driver of innovation. And there’s no harder challenge for CX than in the face of large scale ecommerce. This talk focuses on where streaming fits in, along with our experiential tidbits of working with over half a dozen top retailers. We will specifically talk through
• Inventory Awareness (and why real-time inventory is crucial)
• How dynamic pricing is the final frontier of personalization
• Optimizing costs of commerce: advertising, shipping and with predictive insights on fresh data trends
Speakers
- Tijo Thomas
Manager, Solutions Architect @ Imply. An experienced Data Engineer with 20+ years of experience as Architect , Global Lead Solutions Architect, Software Engineer (R&D), mostly in the area of big data and streaming technologies. He has been part of developing big data platform and also helping customers in solving their Data challenges using Bigdata, Spark and Druid. During this time he has collected best practices, patterns and anti-patterns applied in production environments. - Ramiz Mehran
Software Architect at Meesho - Ashwin Venkatesan
Senior Consultant at Platformatory working mainly on Apache Kafka and Kubernetes. Ashwin has done multiple projects building scalable data pipelines incorporating Apache Kafka in production scenarios. He also dabbles in Data science and Machine learning in his free time. His hobbies include traveling, cooking, and following Manchester United : )
