Batch data read from XLSDataReader

kreddy

• July 10, 2015 00:00

• Answered

Follow

Hi ,

I am just started working on CloverETL.Could any one help me the better approach for below requirement.

- From excel file(75000 records) data should read as batches(5000 records at time)
- Transformer component to parse 5000 records to JSON list
- above JSON list should pass to HTTPConnector
- HTTP response success to CSV failure to CSV file

Appreciate your help.

Thanks,
Kalpana.

• 

  slechtaj

  • July 15, 2015 13:52

  0

  Comment actions Permalink

  Hi Kalpana,
  
  There is no need to read data from the XLS file in batches (in fact nothing like that would solve your situation) - this can be simply done by using "Records per file" attribute (set to 5000 in your case) of JSONWriter, which tells the component to use that amount of incoming records to compose the output JSON structure.
  
  For more information about JSONWriter please refer to our documentation.
  
  Hope it helps.
• 

  kreddy

  • July 21, 2015 05:40

  0

  Comment actions Permalink

  Thank you so much for your reply.I will try the option you suggested.
  
  Thanks,
  Kalpana.

Please sign in to leave a comment.