tag:blogger.com,1999:blog-2202766463251903159.post3338609949371624713..comments2024-03-28T04:37:43.566-07:00Comments on Sunil's Notes: Configuring Flume to write avro events into HDFSSunil Patilhttp://www.blogger.com/profile/16075929903536310688noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-2202766463251903159.post-40707557875658194622016-10-13T23:18:01.055-07:002016-10-13T23:18:01.055-07:00hi can u tell me how to start avro source. like af...hi can u tell me how to start avro source. like after creating the conf file. what exactly should i do? is it enough if i just run the conf file from command prompt. which data will get saved in hdfs? kindly explain. it would be a great help to me. thansk Anonymoushttps://www.blogger.com/profile/13094537214484203299noreply@blogger.comtag:blogger.com,1999:blog-2202766463251903159.post-35192851358676192462015-11-12T23:31:29.539-08:002015-11-12T23:31:29.539-08:00Hi,
I am attempting to do a similar configuration...Hi,<br /><br />I am attempting to do a similar configuration from a kafka source where the data is in avro.<br />Using the avro event sterializer as you have "org.apache.flume.sink.hdfs.AvroEventSerializer$Builder" my data is being printed to file without the formatting ie. {"Name":"myName", "Surname":"mySurnaeme"} is printed to HDFS as "myNamemySurname".<br /><br />When I try to view the data in HUE I get the following message, <br />1. Warning: some binary data has been masked out with '&#xfffd'.<br />2. SEQ !org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable`9g(}�5�l�~�,�XS" P���� � myName mySurname<br />Is anyone aware of how I can solve this issue?<br /><br />Regards,<br />KirstenAnonymousnoreply@blogger.com