Merging flows from different csv files.

rasputinjones

• June 02, 2010 00:00

• Answered

Follow

Hi I'm trying to merge flows from different CSV files that look like this...

CSV_A
-----

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, , , , 6

CSV_B
-----

Titles: Foo, Bar, Baz, Etch, Meh
ROws: 1, 2, ,4, ,

CSV_C
-----

Titles: Foo, Bar, Baz, Etch, Meh
Rows, 1, , 3, , 5,

Desired Output

Titles: Foo, Bar, Baz, Etch, Meh
Rows: 1, 2, 3, 4, 5, 6

How would one go about this with Clover? What component or component(s) to use?

Thanks,

Rasputin.

• 

  avackova

  • June 03, 2010 12:48

  0

  Comment actions Permalink

  Hello,
  I see two scenarios to achieve the aim:

  
  
  • DataReader --> ExtSort --> Denormalizer - Data Reader reads all the files using wild-cards, if the key doesn't exist it can be created by source_row_count auto filling function
  
  
  • Data Readers ==> MergeJoin - each reader reads its own file, key can be also generated by source_row_count or global_row_count auto filling function
• 

  rasputinjones

  • June 06, 2010 23:52

  0

  Comment actions Permalink

  Right on! Went with the denormalize option.
  
  CloverETL is so righteous...!!! :)

Please sign in to leave a comment.