Replacing Mirror-Maker with linked in Brooklin

Problem: Mirror Maker has been used extensively to replicate data between different cluster of Kafka . Its time to expand horizon and create a more stable data transfer framework which removes shortcomings of Mirror Maker. Solution: Mirror Maker at the core is a kaka publisher subscriber taking data from one cluster and pushing to another... Continue Reading →

Identifying Hidden Kafka Consumer after re-balance

We started noticing that at times we would get re-balance Kafka consumer group and suddenly we would notice our application consumer stop getting messages . And then before we could run some diagnostics it would re-balance again and our consumer would start getting messages but we would have lost some messages in between .

Blog at WordPress.com.

Up ↑