- Home
- Consulting
-
Services
What We Do
Professional Services Field Engineering Strategic Program Delivery Mission Critical SupportBy Technology
By Industries
- Talks
- Write Ahead Log
- Company
WeWork Embassy Tech Village, BLOCK-L, Embassy TechVillage, Outer Ring Rd, Devarabisanahalli, Bellandur, Bengaluru, Karnataka 560103
| Name | Speaker | Start Time | End Time | Presentation | Recording |
|---|---|---|---|---|---|
| Welcome and registration | 04:00 PM | 04:45 PM | |||
| Transforming Your APIs Into Business Gold – Architecting a Real-Time API Usage Analytics Platform | Dunith Danushka, Redpanda | 04:45 PM | 05:45 PM | ||
| Snacks & Networking | 05:45 PM | 06:15 PM | |||
| Unified access layer for Kafka resources | Avinash Upadhyaya & Pavan Keshavamurthy, Platformatory | 06:15 PM | 07:15 PM | ||
| Conclusion | 07:15 PM | 07:30 PM |
Speaker: Dunith Danushka, Developer Advocate at Redpanda
About the talk: In today’s hyper-connected digital landscape, real-time API usage analysis and billing have become paramount. With the proliferation of APIs at the heart of modern applications and services, gaining real-time insights into their use is often mission-critical as it depends on critical factors such as latency, throughput, freshness, and the correctness of generated insights. This talk discusses the architecture of a real-time API usage analytics system composed of Redpanda, Apache Flink, and Apache Pinot. Redpanda, as a scalable streaming data platform, enables high-volume, low-latency API volume data ingestion from API gateways in real time. The ingested data is streamed through Flink for streaming ETL, enabling operations like joins, aggregations, and transformations, feeding the final output of the pipeline to Apache Pinot for serving analytics at scale. In addition to that, we will use Flink for rate-limiting incoming API requests. Having such a system enables businesses to make informed, agile decisions, addressing performance bottlenecks, security threats, and resource allocation issues in the API infrastructure promptly. Also, it ensures seamless user experiences by identifying usage patterns, issues, and opportunities as they occur, proactively enhancing the quality of your product. Whether you’re a data engineer, an application developer, or an architect, this talk promises to equip you with the knowledge and tools to build a real-time analytics solution that empowers your organization with the insights it needs to stay ahead in a data-driven world.
Speaker: Avinash Upadhyaya and Pavan Keshavamurthy, Platformatory
About the talk: As the adoption of Kafka increases in an organization, a common pattern is the adoption of Platform Engineering with a cental team managing Kafka clusters. However, in order to truly decouple the developers from managing Kafka clusters, a common access layer for the Kafka clusters might be necessary for migration, centrally managing authentication & authorization, DR and enforcing best practices & optimizations. In this talk, we will explore options for building a Kafka platform with an unified access layer for developers using Kafka.
