Another Issue

oldforum

• July 16, 2007 00:00

• Answered

Follow

Hello,


Thanks for the post.

I will try the solutions you have provided. I actually wrote a little java program that converts the file into a fixed length format( Believe me I do not want to write this kind of code) I got past the problem with this work around.

But the issue I am having is that two fields in the file are over 2000 chars. I kept getting a null pointer error when these fields were parsed by Clover.

I finally restricted the column length to 500 and the graph completed sucessfully.

Are there any restrictions with respect to Column lengths in Clover? Attached is my format file.


<?xml version="1.0" encoding="ISO-8859-1"?>
<Record name="Detail" type="fixed">
<Field name="Mid" type="string" size="20" />
<Field name="Hash" type="string" size="50"/>
<Field name="Cid" type="string" size="50"/>
<Field name="Tid" type="string" size="50"/>
<Field name="Rh" type="string" size="50"/>
<Field name="Vt" type="string" size="50"/>
<Field name="HtmDdg" type="string" size="500"/>
<Field name="TxtDdg" type="string" size="500"/>
</Record>

• 

  oldforum

  • July 16, 2007 08:23

  0

  Comment actions Permalink

  Hi,
  
  there is a limit for the length of String field - currently 32k. The problem is caused by parser which has internal buffer for parsing fields set to 512 characters max. This is hardcoded value.
  One more limitation is that curently the max record length is limited to 8192bytes. But can be change the same way as the parser limitation - see below:
  
  I can fix the problem for you (would take a day or two to process), or you can go to org.jetel.data.Defaults
  and change FIELD_BUFFER_LENGTH (under DataParser internal class) constant to something like 2048 or higher - currently is 512.
  Then recompile the source code package.

Please sign in to leave a comment.