Where Should Your Data Live? Local NVMe, Object Storage and the Memory Hierarchy
"Local NVMe or S3?" is the wrong question. Decide which tier holds the truth, which tiers cache it, and what a miss costs.
TechMart Enterprise Voice Agent: Building a Sovereign AI Voice Support System for Indian Telecom
How do you build a real-time, telephony-native AI agent that handles customer support calls end-to-end in native Indian languages, without a human in the loop? This post walks through the...
Streaming Kafka Data into Oracle: JDBC Sink Connector, Upserts, and LOB Handling
Data streaming projects often begin by capturing source data into Kafka. The next step is delivering that data to downstream systems, such as Oracle databases, for reporting, application integration, modernization,...
Flink vs Spark: A Real-World Latency Showdown with Kafka
A real-world latency comparison between Apache Spark and Apache Flink using Kafka under high-throughput streaming workloads.
How to integrate WASM with Redpanda
Discover the powerful combination of WebAssembly (WASM) and Redpanda in our latest blog post! Learn how to perform real-time data transformations directly within Redpanda, minimizing latency and maximizing efficiency. With...
Migrating from Kafka Connect to Redpanda Connect
Looking to upgrade your data processing? Learn how moving from Kafka Connect to Redpanda Connect can boost your efficiency. Redpanda Connect, formerly Benthos, offers a lightweight, flexible alternative with powerful...
Understanding Redpanda Connect / Benthos
Learn how Redpanda Connect, formerly Benthos, simplifies real-time data streaming and processing. This blog covers its key features, practical use cases, and a comparison to Kafka Connect. Dive in to...
Exploring Kafka UI Solutions: Features, Comparisons, and Use Cases
Curious about the best ways to manage your Apache Kafka clusters? This blog explores the top UI tools that make monitoring and managing Kafka easier. Whether you want to browse...
Operational DB Migrations with Zero Downtime
Operational DB Migrations with Zero Downtime
How to migrate Kafka clusters without downtime
Migrating Kafka clusters can be challenging, but with the right approach, you can minimize downtime and ensure a smooth transition. Explore our guide for practical steps and strategies to help...
Building a Robust Data Pipeline with Kafka and ClickHouse
Discover how to build a powerful real-time data pipeline using Kafka and ClickHouse. This blog guides you through setting up a system that streams and analyzes data instantly, ensuring your...
Kafka Streams Push Gateway
Kafka Streams Push Gateway
Introduction to Temporal
Discover Temporal, a game-changer in building reliable distributed systems. Learn how its durable functions simplify complex systems and guarantee the reliability of your business logic
Unified access layer for Kafka resources: Part 2A: Python Client SDK
Unified access layer for Kafka resources, Part 2A, Python Client SDK Rule Based Routing Layer
Understanding Temporal Interceptors: Enhancing Workflow Management
Boost Your Temporal Workflows with Interceptors - Dive into how you can leverage Temporal Interceptors to inject custom logic into your workflows and activities, enhancing control flow, and adding a...
Monitoring: How to monitor AWS MSK Cluster
Monitoring, How to monitor AWS MSK Cluster
Automating Kafka Deployments with CI/CD
Unlock seamless Kafka cluster management with Kafka CP Deploy Manager! Discover how we can make deployments easier, mitigate human error, and ensures smooth upgrades— all with a user-friendly interface that...
Querying Stream Processing Systems (Apache Flink)
How to query the state store in a stream processing system such as Apache Flink for unifying Operational and Analytical data.
Comparison of Kafka Deployment Options on Kubernetes
Comparison of Kafka Deployment Options on Kubernetes
From Code to Cluster: Simplifying Infrastructure with IaC and Kafka
Discover how Infrastructure as Code (IaC) can revolutionize your Kafka setup by simplifying management and boosting automation. Learn how to leverage IaC for scalable, error-free Kafka operations and transform your...
Learning by Debugging: Kafka Local Setup
Discover how to set up and troubleshoot a local Kafka environment using Docker Compose and Ansible, gain hands-on experience and debugging skills in a safe, isolated setting. Dive into real-world...
Unlocking The Potential of Local Kafka
Unlock the full potential of local Kafka setups for rapid development, testing, and seamless management and discover the best method for your local kafka setup.
Authentication to Confluent Cloud Using OAuth/OIDC with Auth0 as Identity Provider
Unlock the power of secure authentication and authorization by integrating Auth0 with Confluent Cloud. In this guide, we'll walk you through configuring OAuth 2.0 and OIDC, ensuring a seamless and...
Tooling and Process: Lessons from running Kafka at scale for mission critical customers
Dive into our journey of deploying Apache Kafka at scale for fintech clients, navigating challenges and implementing solutions for mission-critical success
Seamless Authentication to Confluent Cloud Using OAuth/OIDC with Okta as Identity Provider
Want to streamline your Kafka authentication? Learn how to effortlessly integrate Confluent Cloud with OAuth/OIDC using Okta as your identity provider. This guide covers everything you need to set up...
Real Time Data Architecture In Retail
Discover how real-time data architecture can revolutionize retail operations, from customer engagement to dynamic pricing and inventory management.
Migrating Zookeeper to Kraft
Ready to simplify your Kafka setup? Discover why moving from ZooKeeper to KRaft could be a game-changer for your infrastructure. This guide walks you through each step of the migration...
Unified access layer for Kafka resources: Part 2: Rule Based Routing Layer
Unified access layer for Kafka resources, Part 2, Rule Based Routing Layer
A Primer on Streaming Databases
Why streaming databases are the rage and what makes them the hottest thing in the world of streaming. A deep dive into important characteristics of a few streaming DBs with...
A leaderless future: kafka-esque story on what is becoming mainstream
kafka-esque story on what is becoming mainstream
Unified Access Layer for Kafka Resources: Part 1
Unified access layer for Kafka resources, Part 1
Chargeback for Kafka clusters
Solving for cost attribution and chargeback in Multi-tenant Kafka clusters
Interceptors for Librdkafka
Building Kafka interceptors for librdkafka clients
Flink Deployment Patterns
Overview of available deployment patterns for Flink Cluster
End-To-End Streaming Pipeline using KSQLDB and Kafka Connect
Complete End-to-End stream processing pipeline using KSQLDB and Kafka Connect with both Confluent Cloud and Standalone Confluent Platform
The Kafka benchmarking suite
Distributed testing grid for Kafka on top of Kubernetes
Command Processing and Event Driven Workflows with Apache Kafka and Airflow
Reactive Command processing in real time using Apache Kafka and by utilising Workflow architecture in Apache Airflow
Kafka batch processing with Airflow
Batch processing from Kafka Topics by using Apache Airlfow DAG
Faust 101 - Stream processing
A quick beginners walkthorugh on Faust - python stream processing library