Problem: Mirror Maker has been used extensively to replicate data between different cluster of Kafka . Its time to expand horizon and create a more stable data transfer framework which removes shortcomings of Mirror Maker. Solution: Mirror Maker at the core is a kaka publisher subscriber taking data from one cluster and pushing to another... Continue Reading →
As an analysis for an issue I had to write a simple java web socket client site code connecting to a Spring based application on the server side with a stomp based web socket broker .
We started noticing that at times we would get re-balance Kafka consumer group and suddenly we would notice our application consumer stop getting messages . And then before we could run some diagnostics it would re-balance again and our consumer would start getting messages but we would have lost some messages in between .
Making Kafka Consumer only read messages till a specified position .Specially to the point where another consumer stopped reading .
Lately i was involved in lot of discussion at work whether HATEOAS is a good option for our new REST application which would serve as an interface to multiple back-end services we have been building . I believe there is no need for me explain the concept of HATEOAS here as there are good enough... Continue Reading →