Sunil's Notes

.In the Using ElasticSearch as external data store with apache hive entry i talked about how you can create a table in Hive so that actual...

I was using a Cloudera Quickstart docker image for one experiment and wanted to install ElasticSearch on it but i had trouble in accessing ...

Sometime back i wrote couple of articles for Java World about Kafka Big data messaging with Kafka, Part 1 and Big data messaging with Kafka...

In the How to run Sqoop command from oozie entry i talked about how you can use Oozie and Sqoop to import data into HDFS. I wanted to chang...

In the Importing data from Sqoop into Hive External Table with Avro encoding updated i blogged about how you can use sqoop to import data f...

In the Importing data from Sqoop into Hive External Table with Avro encoding i had details on how you can import a table from RDBMS into H...

ElasticSearch for Apache Hadoop project has introduced a way to directly write to ElasticSearch without going through Elastic Search Output...

Apache Kafka has a KafkaLog4jAppender that you can use for redirecting your Log4j log to Kafka topic. I wanted to try it out so i used follo...

I wanted to figure out how to write Word Count Program using Spark DataFrame API, so i followed these steps. Import org.apache.spark.sql.fu...

In the i talked about how to create a custom UDF in scala for spark. But before you do that always check Spark UDF's that are availabl...