Data retained in kafka topic even after retention.ms is passed.
Retention period and issue with Kafka data not getting deleted
Challenges of moving from Kafka Mirror Maker to Brooklin for SSL Kafka Brokers
Challenges of moving from Kafka Mirror Maker to Brooklin for SSL kafka Brokers
Replacing Mirror-Maker with linked in Brooklin
Problem: Mirror Maker has been used extensively to replicate data between different cluster of Kafka . Its time to expand horizon and create a more stable data transfer framework which removes shortcomings of Mirror Maker. Solution: Mirror Maker at the core is a kaka publisher subscriber taking data from one cluster and pushing to another... Continue Reading →
Identifying Hidden Kafka Consumer after re-balance
We started noticing that at times we would get re-balance Kafka consumer group and suddenly we would notice our application consumer stop getting messages . And then before we could run some diagnostics it would re-balance again and our consumer would start getting messages but we would have lost some messages in between .
Read data till Kafka Consumer Committed Position
Making Kafka Consumer only read messages till a specified position .Specially to the point where another consumer stopped reading .
Fix Technology Daily 