Customer Portal

Problem in Implementing CompanyTransactionsTutorial example

  1. CloverDX Customer Portal
  2. Forum
  3. Problem in Implementing CompanyTransactionsTutorial example
Avatar
mgarg
  • Answered
Follow
Hi all,
I am new in CloverEtl. I am trying to implement CompanyTransactionsTutorial in CloverEtl Designer version.
Well, in that the first graph is about splitting transactions(A01_SplittingTransactions.grf).
When I am implementing it in CloverEtl Community, it is giving the expected result but when I am implementing it in CloverEtl Designer, its not giving the expected result.

the result it is giving is as follows:

INFO [main] - *** CloverETL framework/transformation graph, (c) 2002-2011 Javlin a.s, released under GNU Lesser General Public License ***
INFO [main] - Running with CloverETL library version 3.2.0 build#57 compiled 20/12/2011 01:02:50
INFO [main] - Running on 2 CPU(s), OS Linux, architecture i386, Java version 1.6.0_24, max available memory for JVM 241536 KB
INFO [main] - Loading default properties from: defaultProperties
INFO [main] - Graph definition file: graph/A01_SplittingTransactions.grf
INFO [main] - Graph revision: 1.32 Modified by: mgarg Modified: Wed Feb 08 15:56:01 IST 2012
INFO [main] - Checking graph configuration...
INFO [main] - Graph configuration is valid.
INFO [main] - Graph initialization (A01_SplittingTransactions)
INFO [main] - [Clover] Initializing phase: 0
INFO [main] - [Clover] phase: 0 initialized successfully.
INFO [main] - register MBean with name:org.jetel.graph.runtime:type=CLOVERJMX_1328616503664_0
INFO [WatchDog] - Starting up all nodes in phase [0]
INFO [WatchDog] - Successfully started all nodes in phase!
INFO [WatchDog] - [Clover] Post-execute phase finalization: 0
INFO [WatchDog] - [Clover] phase: 0 post-execute finalization successfully.
INFO [WatchDog] - ----------------------** Final tracking Log for phase [0] **---------------------
INFO [WatchDog] - Time: 08/02/12 15:56:13
INFO [WatchDog] - Node ID Port #Records #KB aRec/s aKB/s
INFO [WatchDog] - ---------------------------------------------------------------------------------
INFO [WatchDog] - TransactionsDelimited TRANSACTIONS_DELIMITED FINISHED_OK
INFO [WatchDog] - %cpu:.. Out:0 100000 10991 20000 2198
INFO [WatchDog] - Splitting Data SPLITTING_DATA1 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 100000 10991 20000 2198
INFO [WatchDog] - Out:0 100000 2581 20000 516
INFO [WatchDog] - Out:1 0 0 0 0
INFO [WatchDog] - Out:2 0 0 0 0
INFO [WatchDog] - Out:3 0 0 0 0
INFO [WatchDog] - ExtSort EXT_SORT3 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - Dedup DEDUP3 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - EmployeesDelimited EMPLOYEES_DELIMITED FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - ExtSort EXT_SORT2 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - Dedup DEDUP2 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - CustomersDelimited CUSTOMERS_DELIMITED FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - ExtSort EXT_SORT1 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - Dedup DEDUP1 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - Out:0 0 0 0 0
INFO [WatchDog] - AmountsDelimited AMOUNTS_DELIMITED FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 0 0 0 0
INFO [WatchDog] - ExtSort EXT_SORT0 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 100000 2581 20000 516
INFO [WatchDog] - Out:0 100000 2581 20000 516
INFO [WatchDog] - Dedup DEDUP0 FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 100000 2581 20000 516
INFO [WatchDog] - Out:0 100000 2581 20000 516
INFO [WatchDog] - IDsDelimited IDS_DELIMITED FINISHED_OK
INFO [WatchDog] - %cpu:.. In:0 100000 2581 20000 516
INFO [WatchDog] - ---------------------------------** End of Log **--------------------------------
INFO [WatchDog] - Execution of phase [0] successfully finished - elapsed time(sec): 5
INFO [WatchDog] - -----------------------** Summary of Phases execution **---------------------
INFO [WatchDog] - Phase# Finished Status RunTime(sec) MemoryAllocation(KB)
INFO [WatchDog] - 0 FINISHED_OK 5 7992
INFO [WatchDog] - ------------------------------** End of Summary **---------------------------
INFO [WatchDog] - WatchDog thread finished - total execution time: 5 (sec)
INFO [main] - Freeing graph resources.
INFO [main] - Execution of graph successful !



Only one OUT:0 port is sending 100000 records whereas others(OUT:1, OUT:2, OUT:3) are sending 0 records.

I am not able to understand where I am going wrong. Can anyone help me to resolve this problem.



Thanks

Comments 3

Sort by Date Votes
  • Avatar
    admin
    0
    Comment actions Permalink
    Hi MGarg,

    Do you use unaltered version of graph from examples? If you changed it (seems to me there are different names of components), or build your own version, can you please send me your graph?

    Thank you
  • Avatar
    mgarg
    0
    Comment actions Permalink
    HI,
    Thanx for your response.

    This is my graph below:

    <?xml version="1.0" encoding="UTF-8"?>
    <Graph author="mgarg" created="Wed Feb 08 12:01:07 IST 2012" guiVersion="3.1.2" id="1328683151495" licenseCode="community" licenseType="Community" modified="Wed Feb 08 12:27:15 IST 2012" modifiedBy="mgarg" name="A01_SplittingTransactions" revision="1.2" showComponentDetails="true">
    <Global>
    <Metadata id="Metadata1">
    <Record fieldDelimiter="|" name="Amounts" recordDelimiter="\n" type="delimited">
    <Field name="AmountID" type="string"/>
    <Field name="Amount" type="string"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata2">
    <Record fieldDelimiter="|" name="Customers" recordDelimiter="\n" type="delimited">
    <Field name="CustomerID" type="string"/>
    <Field name="CustomerState" type="string"/>
    <Field name="CustomerSurname" type="string"/>
    <Field name="CustomerFirstname" type="string"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata3">
    <Record fieldDelimiter="|" name="Employees" recordDelimiter="\n" type="delimited">
    <Field name="EmployeeID" type="string"/>
    <Field name="EmployeeSurname" type="string"/>
    <Field name="EmployeeFirstname" type="string"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata4">
    <Record fieldDelimiter="|" name="IDs" recordDelimiter="\n" type="delimited">
    <Field name="AmountID" type="string"/>
    <Field name="CustomerID" type="string"/>
    <Field name="EmployeeID" type="string"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata0" previewAttachment="${DATAIN_DIR}/Transactions.dat" previewAttachmentCharset="ISO-8859-1">
    <Record fieldDelimiter=";" name="Transactions_dat" previewAttachment="${DATAIN_DIR}/Transactions.dat" previewAttachmentCharset="ISO-8859-1" recordDelimiter="\n" skipSourceRows="0" type="delimited">
    <Field name="AmountID" type="string"/>
    <Field name="Amount" type="string"/>
    <Field name="CustomerID" type="string"/>
    <Field name="CustomerState" type="string"/>
    <Field name="CustomerSurname" type="string"/>
    <Field name="CustomerFirstname" type="string"/>
    <Field name="EmployeeID" type="string"/>
    <Field name="EmployeeSurname" type="string"/>
    <Field eofAsDelimiter="false" name="EmployeeFirstname" type="string"/>
    </Record>
    </Metadata>
    <Property fileURL="workspace.prm" id="GraphParameter0"/>
    <Dictionary/>
    </Global>
    <Phase number="0">
    <Node enabled="enabled" fileURL="${DATAIN_DIR}/Transactions.dat" guiHeight="99" guiName="" guiWidth="128" guiX="9" guiY="130" id="DATA_READER0" type="DATA_READER"/>
    <Node enabled="enabled" fileURL="${DATATMP_DIR}/IDs.dat" guiHeight="84" guiName="UniversalDataWriter" guiWidth="186" guiX="718" guiY="32" id="DATA_WRITER0" type="DATA_WRITER"/>
    <Node enabled="enabled" fileURL="${DATATMP_DIR}/Amounts.dat" guiHeight="99" guiName="UniversalDataWriter" guiWidth="186" guiX="718" guiY="130" id="DATA_WRITER1" type="DATA_WRITER"/>
    <Node enabled="enabled" fileURL="${DATATMP_DIR}/Customers.dat" guiHeight="99" guiName="UniversalDataWriter" guiWidth="186" guiX="734" guiY="249" id="DATA_WRITER2" type="DATA_WRITER"/>
    <Node enabled="enabled" fileURL="${DATATMP_DIR}/Employees.dat" guiHeight="99" guiName="UniversalDataWriter" guiWidth="186" guiX="734" guiY="361" id="DATA_WRITER3" type="DATA_WRITER"/>
    <Node dedupKey="AmountID(a);CustomerID(a);EmployeeID(a)" enabled="enabled" guiHeight="69" guiName="Dedup" guiWidth="128" guiX="548" guiY="32" id="DEDUP0" type="DEDUP"/>
    <Node dedupKey="AmountID(a)" enabled="enabled" guiHeight="69" guiName="Dedup" guiWidth="128" guiX="559" guiY="130" id="DEDUP1" type="DEDUP"/>
    <Node dedupKey="CustomerID(a)" enabled="enabled" guiHeight="69" guiName="Dedup" guiWidth="128" guiX="568" guiY="249" id="DEDUP2" type="DEDUP"/>
    <Node dedupKey="EmployeeID(a)" enabled="enabled" guiHeight="69" guiName="Dedup" guiWidth="128" guiX="574" guiY="346" id="DEDUP3" type="DEDUP"/>
    <Node enabled="enabled" guiHeight="99" guiName="ExtSort" guiWidth="128" guiX="404" guiY="32" id="EXT_SORT0" sortKey="AmountID(a);CustomerID(a);EmployeeID(a)" type="EXT_SORT"/>
    <Node enabled="enabled" guiHeight="84" guiName="ExtSort" guiWidth="128" guiX="404" guiY="137" id="EXT_SORT1" sortKey="AmountID(a)" type="EXT_SORT"/>
    <Node enabled="enabled" guiHeight="84" guiName="ExtSort" guiWidth="128" guiX="404" guiY="243" id="EXT_SORT2" sortKey="CustomerID(a)" type="EXT_SORT"/>
    <Node enabled="enabled" guiHeight="84" guiName="ExtSort" guiWidth="128" guiX="404" guiY="346" id="EXT_SORT3" sortKey="EmployeeID(a)" type="EXT_SORT"/>
    <Node enabled="enabled" guiHeight="84" guiName="Reformat" guiWidth="128" guiX="236" guiY="130" id="REFORMAT0" type="REFORMAT">
    <attr name="transform"><![CDATA[//#CTL2

    // Transforms input record into output record.
    function integer transform() {
    $0.AmountID = $0.AmountID;
    $1.Amount = $0.Amount;
    $0.CustomerID = $0.CustomerID;
    $2.CustomerState = $0.CustomerState;
    $2.CustomerSurname = $0.CustomerSurname;
    $2.CustomerFirstname = $0.CustomerFirstname;
    $0.EmployeeID = $0.EmployeeID;
    $3.EmployeeSurname = $0.EmployeeSurname;
    $3.EmployeeFirstname = $0.EmployeeFirstname;
    $1.AmountID = $0.AmountID;
    $2.CustomerID = $0.CustomerID;
    $3.EmployeeID = $0.EmployeeID;

    return ALL;
    }

    // Called during component initialization.
    // function boolean init() {}

    // Called during each graph run before the transform is executed. May be used to allocate and initialize resources
    // required by the transform. All resources allocated within this method should be released
    // by the postExecute() method.
    // function void preExecute() {}

    // Called only if transform() throws an exception.
    // function integer transformOnError(string errorMessage, string stackTrace) {}

    // Called during each graph run after the entire transform was executed. Should be used to free any resources
    // allocated within the preExecute() method.
    // function void postExecute() {}

    // Called to return a user-defined error message when an error occurs.
    // function string getMessage() {}
    ]]></attr>
    </Node>
    <Edge fromNode="DATA_READER0:0" guiBendpoints="" guiRouter="Manhattan" id="Edge0" inPort="Port 0 (in)" metadata="Metadata0" outPort="Port 0 (output)" toNode="REFORMAT0:0"/>
    <Edge fromNode="DEDUP0:0" guiBendpoints="" guiRouter="Manhattan" id="Edge9" inPort="Port 0 (in)" metadata="Metadata4" outPort="Port 0 (unique)" toNode="DATA_WRITER0:0"/>
    <Edge fromNode="DEDUP1:0" guiBendpoints="" guiRouter="Manhattan" id="Edge10" inPort="Port 0 (in)" metadata="Metadata1" outPort="Port 0 (unique)" toNode="DATA_WRITER1:0"/>
    <Edge fromNode="DEDUP2:0" guiBendpoints="" guiRouter="Manhattan" id="Edge11" inPort="Port 0 (in)" metadata="Metadata2" outPort="Port 0 (unique)" toNode="DATA_WRITER2:0"/>
    <Edge fromNode="DEDUP3:0" guiBendpoints="" guiRouter="Manhattan" id="Edge12" inPort="Port 0 (in)" metadata="Metadata3" outPort="Port 0 (unique)" toNode="DATA_WRITER3:0"/>
    <Edge fromNode="EXT_SORT0:0" guiBendpoints="" guiRouter="Manhattan" id="Edge5" inPort="Port 0 (in)" metadata="Metadata4" outPort="Port 0 (out)" toNode="DEDUP0:0"/>
    <Edge fromNode="EXT_SORT1:0" guiBendpoints="" guiRouter="Manhattan" id="Edge6" inPort="Port 0 (in)" metadata="Metadata1" outPort="Port 0 (out)" toNode="DEDUP1:0"/>
    <Edge fromNode="EXT_SORT2:0" guiBendpoints="" guiRouter="Manhattan" id="Edge7" inPort="Port 0 (in)" metadata="Metadata2" outPort="Port 0 (out)" toNode="DEDUP2:0"/>
    <Edge fromNode="EXT_SORT3:0" guiBendpoints="" guiRouter="Manhattan" id="Edge8" inPort="Port 0 (in)" metadata="Metadata3" outPort="Port 0 (out)" toNode="DEDUP3:0"/>
    <Edge fromNode="REFORMAT0:0" guiBendpoints="" guiRouter="Manhattan" id="Edge1" inPort="Port 0 (in)" metadata="Metadata4" outPort="Port 0 (out)" toNode="EXT_SORT0:0"/>
    <Edge fromNode="REFORMAT0:1" guiBendpoints="" guiRouter="Manhattan" id="Edge2" inPort="Port 0 (in)" metadata="Metadata1" outPort="Port 1 (out)" toNode="EXT_SORT1:0"/>
    <Edge fromNode="REFORMAT0:2" guiBendpoints="" guiRouter="Manhattan" id="Edge3" inPort="Port 0 (in)" metadata="Metadata2" outPort="Port 2 (out)" toNode="EXT_SORT2:0"/>
    <Edge fromNode="REFORMAT0:3" guiBendpoints="" guiRouter="Manhattan" id="Edge4" inPort="Port 0 (in)" metadata="Metadata3" outPort="Port 3 (out)" toNode="EXT_SORT3:0"/>
    </Phase>
    </Graph>
  • Avatar
    admin
    0
    Comment actions Permalink
    Hi MGarg,

    graph you sent me, is not the one from which log was generated. Log contained in your first post contained names of components like "SPLITTING_DATA1", but the graph you send not. I guess you sent me original graph from our sources (and it works for me).

Please sign in to leave a comment.

Didn't find what you were looking for?

New post