I code daily to fix problems , that's it !! Nothing more
Problem: Mirror Maker has been used extensively to replicate data between different cluster of Kafka . Its time to expand horizon and create a more stable data transfer framework which removes shortcomings of Mirror Maker. Solution: Mirror Maker at the core is a kaka publisher subscriber taking data from one cluster and pushing to another... Continue Reading →
We started noticing that at times we would get re-balance Kafka consumer group and suddenly we would notice our application consumer stop getting messages . And then before we could run some diagnostics it would re-balance again and our consumer would start getting messages but we would have lost some messages in between .
Making Kafka Consumer only read messages till a specified position .Specially to the point where another consumer stopped reading .
