Sunil's Notes

I wanted to figure out how to connect to RDBMS from spark and extract data, so i followed these steps. You can download this project form gi...

Recently i wanted to implement a simple Least recently used (LRU) cache in one my applications. But my use case is simple enough that inste...

In Spark Kafka Streaming Java program Word Count using Kafka 0.10 API blog entry i talked about how you create a simple java program that u...

Kafka API went through a lot of changes starting Kafka 0.9. Spark Kafka Streaming API also was changed to better support Kafka 0.9. i wanted...

.In the Using ElasticSearch as external data store with apache hive entry i talked about how you can create a table in Hive so that actual...

I was using a Cloudera Quickstart docker image for one experiment and wanted to install ElasticSearch on it but i had trouble in accessing ...

Sometime back i wrote couple of articles for Java World about Kafka Big data messaging with Kafka, Part 1 and Big data messaging with Kafka...

In the How to run Sqoop command from oozie entry i talked about how you can use Oozie and Sqoop to import data into HDFS. I wanted to chang...

In the Importing data from Sqoop into Hive External Table with Avro encoding updated i blogged about how you can use sqoop to import data f...

In the Importing data from Sqoop into Hive External Table with Avro encoding i had details on how you can import a table from RDBMS into H...