NEWBIE End of Line Characters NL vs CR vs CRLF

gcoppa

• December 10, 2015 00:00

• Answered

Follow

Greetings,

I am new to Clover ETL. I am learning the Endeca version. I am trying a simple graph consisting of universal reader, an edge and trash. I have created three data files, all the same data except for the line termination character. Line Feed (\n), Carriage Return (\r) and Carriage Return Line feed (\r\n). All I'm am trying to do is read file to trash. CRLF works, however LF or CR does not. Once I figure out what is wrong with the way I am doing this, I will apply the method to the real file of some 45G of data. This file contains three record types and terminates in LF. I have preprocessed this file in C and Perl but would like to use the "one tool" approach and do everything via CloverEtl.

Any suggestions would greatly reduce my current ignorance!!!

Thanks in advance
Jerry Coppa

BTW: I'm a seasoned programmer learning a new tool.

• 

  Lukas Cholasta

  • December 15, 2015 13:30

  0

  Comment actions Permalink

  Hi gcoppa
  
  You can set the delimiter for every field in a record as well as for the record itself, by editing its metadata. If you wan to change the record (line) delimiter just open the metadata editor by double-clicking the appropriate metadata item in the Outline window and select the desired record delimiter. Please see the picture below for more detail.
  
  delimiter.png
  
  Hope this helps

  • delimiter.png

Please sign in to leave a comment.