Loading complete text file content, store filename

alrond

• May 27, 2015 00:00

• Answered

Follow

I need to load the content of all files in a directory. These files are non-delimited raw text files. I need to store the content of each file in one single cell of a table.
Additionally I need to store the source file name for each file in a second column in the same row.

The output would look similar to this:

----------------------------------------------------------------
|This is the content of \n the first file | /path/to/file1.txt |
----------------------------------------------------------------
|This is the \n content of the second one | /path/to/file2.txt |
----------------------------------------------------------------
|......                                   |.....               |

Is there a way to accomplish this in CloverETL? Can I use the UniversalDataReader?

Thanks a lot!
Greetings
Al

• 

  simaj

  • May 28, 2015 09:43

  0

  Comment actions Permalink

  Hi Al,
  
  Yes, UniversalDataReader will do the work. To read whole content in one field, you might want to choose end of file as delimiter:
  
  1. Metadata editor.
  2. Remove records and field delimiter.
  3. Click on the first row in the left panel.
  4. Scroll down in the Details panel to Advanced properties.
  5. Set "EOF as delimiter" to true.
  
  autofill.jpg

  • autofill.jpg
  • EOF.jpg
• 

  alrond

  • May 29, 2015 13:09

  0

  Comment actions Permalink

  Very nice! That does the trick! Thank you a lot!
  
  Greetings Al

Please sign in to leave a comment.