How to get information from HDFS (Claudera 4.3.1)

fabrizio.orlando

• November 24, 2013 00:00

• Answered

Follow

I need to read data from Hadoop using the new Hadoop connectivity components, but I'm stuck in the creating the Hadoop connection (http://doc.cloveretl.com/documentation/ ... tions.html) .
Could you please help on that?
I tried to find working examples to mimic them, but it seems I cannot find anything. I found something in http://www.cloveretl.com/examples, but I didn't find how to download them.
Thanks in advance for your help,
Fabrizio

• 

  novakj

  • November 25, 2013 15:53

  0

  Comment actions Permalink

  Hi Fabrizio,
  
  You can start using Hadoop with CloverETL through the BigDataExamples project. You can import the BigDataExamples into your CloverETL Designer via "File -> New -> Example...", select "CloverETL Examples Project", click Next, select "BigDataExamples" project and click to Finish.
  
  This project contains some sample graphs which are using Hadoop connection. Please see these examples for your inspiration. You only have to set a valid Hadoop connection.
  
  The detailed information about creating the Hadoop connections you can find in the documentation - the link that you have mentioned: http://doc.cloveretl.com/documentation/ ... tions.html
  
  It is also necessary to download Hadoop libraries and place them inside the lib directory in your sandbox and set valid Hadoop connection URL.

Please sign in to leave a comment.