Input Metadata does not equal to Output Metadata

cluna

• November 11, 2013 00:00

• Answered

Follow

I am currently working on modifying an ETL graph that is using ApproximativeJoin to generate some data. I ran into issues after running it a couple of times. The error read something like this:
Metadata "OP_USCCHART2" does not equal to metadata "ACCOUNT_FINAL"

OP_USCCHART2 is the master data and ACCOUNT_FINAL is the output metadata.

Are there rules for Metadata compatibility when using ApproxJoins?

Thanks

• 

  novakj

  • November 12, 2013 15:32

  0

  Comment actions Permalink

  Hello,
  
  At the ApproximativeJoin component is necessary to set the same metadata on the following ports (zero based indexing):
  
  

  
  
  • Input port 0 has equal metadata as output port 2
  
  
  • Input port 1 has equal metadata as output port 3

  
  
  The output ports 2 and 3 are used for master data records without slave matches (port 2), respectively slave data records without master matches (port 3), so it is necessary to set corresponding metadata.
  
  For more information please see the documentation, section Ports:
  http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/aproxmergejoin.html
  
  Could you please check the metadata of your ports?
• 

  cluna

  • November 12, 2013 16:39

  0

  Comment actions Permalink

  Hi Jiri,
  
  Thanks for the response. What exactly do you mean when you say "equal metadata"? I'm really new to ETL and want to know more.
  
  Again, thanks!
• 

  novakj

  • November 13, 2013 12:14

  0

  Comment actions Permalink

  Hi,
  
  Every edge of a graph carries some data and the metadata describes the data. You have to set the metadata for every edge of your graph.
  
  At the ApproximativeJoin component you have to set the metadata of some ports as I have written above. It means you have to set properly the metadata on the edges for corresponding ports. You have to set the same metadata of the edge going to the input port 0 as the metadata of the edge connected to the output port 2 and same metadata on the input port 1 and output port 3.
  
  For more information about metadata, please see the documentation:
  http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/metadata.html
  
  If you are new to the CloverETL, I can recommend you the Quick Start Guide:
  http://www.cloveretl.com/documentation/quickstart

Please sign in to leave a comment.