Sunil's Notes

Some time you might have a bad record in Kafka topic that you want to delete. Kafka does not provide direct option to delete specific record...

I wanted to figure out how to reset number of partitions in my topic in Kafka and I followed these steps I did create a sample topic call...

First run describe on topic to check what it the current LAG its zero in this case bin/kafka-consumer-groups.sh --bootstrap-server localhos...

I wanted to figure out how to connect to RDBMS from spark and extract data, so i followed these steps. You can download this project form gi...

Recently i wanted to implement a simple Least recently used (LRU) cache in one my applications. But my use case is simple enough that inste...

In Spark Kafka Streaming Java program Word Count using Kafka 0.10 API blog entry i talked about how you create a simple java program that u...

Kafka API went through a lot of changes starting Kafka 0.9. Spark Kafka Streaming API also was changed to better support Kafka 0.9. i wanted...

.In the Using ElasticSearch as external data store with apache hive entry i talked about how you can create a table in Hive so that actual...

I was using a Cloudera Quickstart docker image for one experiment and wanted to install ElasticSearch on it but i had trouble in accessing ...

Sometime back i wrote couple of articles for Java World about Kafka Big data messaging with Kafka, Part 1 and Big data messaging with Kafka...