Customer Portal

Connector routing 'Dummy' Component ?

Comments 8

  • Avatar
    Pedro Vazquez Rosario
    0
    Comment actions Permalink
    Hi Andrase,

    Unfortunately we don't have a dummy component per say, but I would highly recommend using the Reformat. Like you know the Reformat allows for the passing of input and output records by simply adding the following line of code:

    $out.0.* = $in.0.*;

    It won't matter to what connector line you add it too the records will be the same for input and output.

    This will simulate a dummy component in your use case.
  • Avatar
    andras.csore
    0
    Comment actions Permalink
    Many Thanks, i do the reformat 'trick'
    Andrase,
  • Avatar
    imriskal
    0
    Comment actions Permalink
    I think SimpleCopy component is definitely prefered over Reformat, its overhead is much lower.

    But the best approach in my opinion is to disable edge autorouting and move the edge wherever you want in the graph.
  • Avatar
    andras.csore
    0
    Comment actions Permalink
    Yes, i agree, the 'disable edge autorouting' is the best overall.
    Thanks for the SimpleCopy idea, one point it get less resource (cpu), in other hand its more resource (time) sensitive (as some disk io needed, even with 200-300MB/sec is can be time consuming). Off course, the disk and cpu need to be balance, but as 200-300MB/sec easy saturate simple SSD drives, the disk i/o is some point of view also my limiting factor to SimpleCopy usage.
    Note: its can be a nice article in the help/kb, how disk i/o - storage space works in real world. My i write it once... (i already has some experience on that, i spend some hours to check it...)
  • Avatar
    imriskal
    0
    Comment actions Permalink
    SimpleCopy does not write anything to the disk so you do not have to worry about the I/O operations.
  • Avatar
    andras.csore
    0
    Comment actions Permalink
    Dear Lubos,

    I'm not fully agree on that. Monitoring the folder (example):
    \workspace\.metadata\.plugins\com.cloveretl.gui.runtime\runtime-work\temp\clover_temp_node01\1\
    => nice SimpleCopy related files everywhere... off course its also some connection with 'Phases', etc.
    I spend quite a few hour to understand how temp files working (when i run out of disk space too much time...)
    Off course, if Disabled, its a different thing, but i just not like the 'transparent' disabled connector lines...

    Andrase,
  • Avatar
    Vladimir Barton
    0
    Comment actions Permalink
    Hi Andrase,
    I dare to presume that what you are seeing in the reported directory is the edge debug data being saved by the Designer. In other words, it is not the SimpleCopy component itself that would write data to the disk. It is the debug setup (on the edge that is pushing data to and/or pulling data from the SimpleCopy component) that affects writing the debug data to the disk. This debug data is typically saved in the binary format to a temp directory (named by the temp runID, for example, "1") in the directory that you specified. You can confirm this by testing the different options of the debug setup (by right-clicking an edge, selecting "Debug" and choosing those various options). If you select the "No Records" option on all your graph edges and run the graph, the temp directory will still be created but no .dbg files will be written into it.
    Best regards,
  • Avatar
    andras.csore
    0
    Comment actions Permalink
    HI Vladimir,
    Your perfectly right. Sorry about my confusion on that (and i also confused because some 'Phase', etc.)
    I do synthetic tests, and yes: the SimpleCopy itself (without debug, phase, etc) practically not create any file by itself.
    Many Thanks!
    Andrase,

Please sign in to leave a comment.