All Posts

Where Should Your Data Live? Local NVMe, Object Storage and the Memory Hierarchy

Where Should Your Data Live? Local NVMe, Object Storage and the Memory Hierarchy

"Local NVMe or S3?" is the wrong question. Decide which tier holds the truth, which tiers cache it, and what a miss costs.

TechMart Enterprise Voice Agent: Building a Sovereign AI Voice Support System for Indian Telecom

TechMart Enterprise Voice Agent: Building a Sovereign AI Voice Support System for Indian Telecom

How do you build a real-time, telephony-native AI agent that handles customer support calls end-to-end in native Indian languages, without a human in the loop? This post walks through the...

Streaming Kafka Data into Oracle: JDBC Sink Connector, Upserts, and LOB Handling

Streaming Kafka Data into Oracle: JDBC Sink Connector, Upserts, and LOB Handling

Data streaming projects often begin by capturing source data into Kafka. The next step is delivering that data to downstream systems, such as Oracle databases, for reporting, application integration, modernization,...

Flink vs Spark: A Real-World Latency Showdown with Kafka

Flink vs Spark: A Real-World Latency Showdown with Kafka

A real-world latency comparison between Apache Spark and Apache Flink using Kafka under high-throughput streaming workloads.

How to integrate WASM with Redpanda

How to integrate WASM with Redpanda

Discover the powerful combination of WebAssembly (WASM) and Redpanda in our latest blog post! Learn how to perform real-time data transformations directly within Redpanda, minimizing latency and maximizing efficiency. With...

Migrating from Kafka Connect to Redpanda Connect

Migrating from Kafka Connect to Redpanda Connect

Looking to upgrade your data processing? Learn how moving from Kafka Connect to Redpanda Connect can boost your efficiency. Redpanda Connect, formerly Benthos, offers a lightweight, flexible alternative with powerful...

Understanding Redpanda Connect / Benthos

Understanding Redpanda Connect / Benthos

Learn how Redpanda Connect, formerly Benthos, simplifies real-time data streaming and processing. This blog covers its key features, practical use cases, and a comparison to Kafka Connect. Dive in to...

Exploring Kafka UI Solutions: Features, Comparisons, and Use Cases

Exploring Kafka UI Solutions: Features, Comparisons, and Use Cases

Curious about the best ways to manage your Apache Kafka clusters? This blog explores the top UI tools that make monitoring and managing Kafka easier. Whether you want to browse...

Operational DB Migrations with Zero Downtime

Operational DB Migrations with Zero Downtime

Operational DB Migrations with Zero Downtime

How to migrate Kafka clusters without downtime

How to migrate Kafka clusters without downtime

Migrating Kafka clusters can be challenging, but with the right approach, you can minimize downtime and ensure a smooth transition. Explore our guide for practical steps and strategies to help...

Building a Robust Data Pipeline with Kafka and ClickHouse

Building a Robust Data Pipeline with Kafka and ClickHouse

Discover how to build a powerful real-time data pipeline using Kafka and ClickHouse. This blog guides you through setting up a system that streams and analyzes data instantly, ensuring your...

Kafka Streams Push Gateway

Kafka Streams Push Gateway

Kafka Streams Push Gateway

Introduction to Temporal

Introduction to Temporal

Discover Temporal, a game-changer in building reliable distributed systems. Learn how its durable functions simplify complex systems and guarantee the reliability of your business logic

Unified access layer for Kafka resources: Part 2A: Python Client SDK

Unified access layer for Kafka resources: Part 2A: Python Client SDK

Unified access layer for Kafka resources, Part 2A, Python Client SDK Rule Based Routing Layer

Understanding Temporal Interceptors: Enhancing Workflow Management

Understanding Temporal Interceptors: Enhancing Workflow Management

Boost Your Temporal Workflows with Interceptors - Dive into how you can leverage Temporal Interceptors to inject custom logic into your workflows and activities, enhancing control flow, and adding a...

Monitoring: How to monitor AWS MSK Cluster

Monitoring: How to monitor AWS MSK Cluster

Monitoring, How to monitor AWS MSK Cluster

Automating Kafka Deployments with CI/CD

Automating Kafka Deployments with CI/CD

Unlock seamless Kafka cluster management with Kafka CP Deploy Manager! Discover how we can make deployments easier, mitigate human error, and ensures smooth upgrades— all with a user-friendly interface that...

Querying Stream Processing Systems (Apache Flink)

Querying Stream Processing Systems (Apache Flink)

How to query the state store in a stream processing system such as Apache Flink for unifying Operational and Analytical data.

Comparison of Kafka Deployment Options on Kubernetes

Comparison of Kafka Deployment Options on Kubernetes

Comparison of Kafka Deployment Options on Kubernetes

From Code to Cluster: Simplifying Infrastructure with IaC and Kafka

From Code to Cluster: Simplifying Infrastructure with IaC and Kafka

Discover how Infrastructure as Code (IaC) can revolutionize your Kafka setup by simplifying management and boosting automation. Learn how to leverage IaC for scalable, error-free Kafka operations and transform your...

Learning by Debugging: Kafka Local Setup

Learning by Debugging: Kafka Local Setup

Discover how to set up and troubleshoot a local Kafka environment using Docker Compose and Ansible, gain hands-on experience and debugging skills in a safe, isolated setting. Dive into real-world...

Unlocking The Potential of Local Kafka

Unlocking The Potential of Local Kafka

Unlock the full potential of local Kafka setups for rapid development, testing, and seamless management and discover the best method for your local kafka setup.

Authentication to Confluent Cloud Using OAuth/OIDC with Auth0 as Identity Provider

Authentication to Confluent Cloud Using OAuth/OIDC with Auth0 as Identity Provider

Unlock the power of secure authentication and authorization by integrating Auth0 with Confluent Cloud. In this guide, we'll walk you through configuring OAuth 2.0 and OIDC, ensuring a seamless and...

Tooling and Process: Lessons from running Kafka at scale for mission critical customers

Tooling and Process: Lessons from running Kafka at scale for mission critical customers

Dive into our journey of deploying Apache Kafka at scale for fintech clients, navigating challenges and implementing solutions for mission-critical success

Seamless Authentication to Confluent Cloud Using OAuth/OIDC with Okta as Identity Provider

Seamless Authentication to Confluent Cloud Using OAuth/OIDC with Okta as Identity Provider

Want to streamline your Kafka authentication? Learn how to effortlessly integrate Confluent Cloud with OAuth/OIDC using Okta as your identity provider. This guide covers everything you need to set up...

Real Time Data Architecture In Retail

Real Time Data Architecture In Retail

Discover how real-time data architecture can revolutionize retail operations, from customer engagement to dynamic pricing and inventory management.

Migrating Zookeeper to Kraft

Migrating Zookeeper to Kraft

Ready to simplify your Kafka setup? Discover why moving from ZooKeeper to KRaft could be a game-changer for your infrastructure. This guide walks you through each step of the migration...

Unified access layer for Kafka resources: Part 2: Rule Based Routing Layer

Unified access layer for Kafka resources: Part 2: Rule Based Routing Layer

Unified access layer for Kafka resources, Part 2, Rule Based Routing Layer

A Primer on Streaming Databases

A Primer on Streaming Databases

Why streaming databases are the rage and what makes them the hottest thing in the world of streaming. A deep dive into important characteristics of a few streaming DBs with...

A leaderless future: kafka-esque story on what is becoming mainstream

A leaderless future: kafka-esque story on what is becoming mainstream

kafka-esque story on what is becoming mainstream

Unified Access Layer for Kafka Resources: Part 1

Unified Access Layer for Kafka Resources: Part 1

Unified access layer for Kafka resources, Part 1

Chargeback for Kafka clusters

Chargeback for Kafka clusters

Solving for cost attribution and chargeback in Multi-tenant Kafka clusters

Interceptors for Librdkafka

Interceptors for Librdkafka

Building Kafka interceptors for librdkafka clients

Flink Deployment Patterns

Flink Deployment Patterns

Overview of available deployment patterns for Flink Cluster

End-To-End Streaming Pipeline using KSQLDB and Kafka Connect

End-To-End Streaming Pipeline using KSQLDB and Kafka Connect

Complete End-to-End stream processing pipeline using KSQLDB and Kafka Connect with both Confluent Cloud and Standalone Confluent Platform

The Kafka benchmarking suite

The Kafka benchmarking suite

Distributed testing grid for Kafka on top of Kubernetes

Command Processing and Event Driven Workflows with Apache Kafka and Airflow

Command Processing and Event Driven Workflows with Apache Kafka and Airflow

Reactive Command processing in real time using Apache Kafka and by utilising Workflow architecture in Apache Airflow

Kafka batch processing with Airflow

Kafka batch processing with Airflow

Batch processing from Kafka Topics by using Apache Airlfow DAG

Faust 101 - Stream processing

Faust 101 - Stream processing

A quick beginners walkthorugh on Faust - python stream processing library