Challenges of moving from Kafka Mirror Maker to Brooklin for SSL kafka Brokers
Challenges of moving from Kafka Mirror Maker to Brooklin for SSL Kafka Brokers
Replacing Mirror-Maker with linked in Brooklin
Problem: Mirror Maker has been used extensively to replicate data between different cluster of Kafka . Its time to expand horizon and create a more stable data transfer framework which removes shortcomings of Mirror Maker. Solution: Mirror Maker at the core is a kaka publisher subscriber taking data from one cluster and pushing to another... Continue Reading →
Identifying Hidden Kafka Consumer after re-balance
We started noticing that at times we would get re-balance Kafka consumer group and suddenly we would notice our application consumer stop getting messages . And then before we could run some diagnostics it would re-balance again and our consumer would start getting messages but we would have lost some messages in between .
Read data till Kafka Consumer Committed Position
Making Kafka Consumer only read messages till a specified position .Specially to the point where another consumer stopped reading .
