Conditional data reading from Flat file

tava.amitava

• July 14, 2009 00:00

• Answered

Follow

Hi,

I am trying to read some data from a flat file which has header, body and footer. The body content type is described in meta file. While reading the file using skipFirstLine attribute I can escape the first line, but the footer is giving an error message that it is not matching as per meta file. How can I resolve this problem.

Also all the data has a mode section to identify it is header, body or footer like:
0|HEADER|2009-07-10|FILE NAME|
1|ABC|A B C|
1|CDF| C D F|
2|FOOTER<End of File>

please note the end of file is in the last line itself.

Tha graph is running well if I give same number of delimiters and a paragraph after last line.
Ex:
0|HEADER|2009-07-10|FILE NAME|
1|ABC|A B C|
1|CDF| C D F|
2|FOOTER||
<End of File>


Can any one please help me sorting out this problem.
Thanks,
Amit

• 

  twaller

  • July 14, 2009 11:30

  0

  Comment actions Permalink

  Hello Amit,
  
  As regards your question, I would like to advise you not to forget the possibility of the Data policy attribute.
  You can switch its default setting (Strict, which causes fails of the graph by each error).
  You can select the other two options: either Controlled, which saves errors to console, or Lenient, which ignores errors and does not save them.
  In both cases, graph does not fail. If you want to parse the mentioned file, set the Skip first line to true. And switch Data policy to any other value than the default Strict.
  It will work, of course, if you do not want to save also the footer.
  
  Best regards
  
  Tomas Waller
• 

  mzatopek

  • July 15, 2009 09:36

  0

  Comment actions Permalink

  Or you can consider to use the MultiLevelReader component.
• 

  tava.amitava

  • July 15, 2009 17:14

  0

  Comment actions Permalink

  Thanks for your help. By setting the datapolicy attribute in reader component to lenient the graph ran successfully.

Please sign in to leave a comment.