problem with merge

oldforum

• July 16, 2007 00:00

• Answered

Follow

I am trying to extract data from a source system, compare it to a previous run, and detect changes with the data intersection task. Then I merge the records that are only in the current source with the records that are only in the previous run (detecting inserts and deletes). however when i have more then 462 records entering the Merge task clover seems to lock up and keeps outputing the tracking log every 30 secons or so with no change in the number of records.
Is this a memory issue or something else? Are there any memory configuration options that help clover?

• 

  oldforum

  • July 16, 2007 08:23

  0

  Comment actions Permalink

  Hello,
  i'm not familiar with source code of the merge sort component, but that looks like a deadlock by waiting incoming records. Try split your two readers and the merge sort component into seprate phases, that's my suggestion to remove dead lock.
  
  OtaSanek

Please sign in to leave a comment.