Customer Portal

Graph aborted on hash join operation

  1. CloverDX Customer Portal
  2. Forum
  3. Graph aborted on hash join operation
Avatar
oldforum
  • Answered
Follow
Hi,

I am trying to join two tables using HASH_JOIN component, and after a long but succeful initialization, I get this log (I have removed duplicate line from log4j) :


---------------------** Start of tracking Log for phase [0] **-------------------
Time: 22/12/05 13:47:52
Node Status Port #Records
---------------------------------------------------------------------------------
oeccp_STR ABORTED
Out:0 6674
obbud_MB ABORTED
Out:0 3
join_on_cgr ABORTED
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:474)
at org.jetel.graph.DirectEdge$EdgeRecordBufferPool.getFullBuffer(DirectEdge.java:352)
at org.jetel.graph.DirectEdge.readRecord(DirectEdge.java:119)
at org.jetel.graph.Edge.readRecord(Edge.java:238)
at org.jetel.graph.Node.readRecord(Node.java:556)
at org.jetel.component.DBOutputTable.runInNormalMode(DBOutputTable.java:406)
at org.jetel.component.DBOutputTable.run(DBOutputTable.java:361)
In:0 3
In:1 6674
Out:0 0
obbud_oeccp FATAL_ERROR
In:0 0
---------------------------------** End of Log **--------------------------------


What is the meaning of this ?

Thanks,
Franck

Comments 5

Sort by Date Votes
  • Avatar
    oldforum
    0
    Comment actions Permalink
    Maybe my problem is related to this description : http://developer.berlios.de/forum/messa ... g_id=21202
    ?
  • Avatar
    oldforum
    0
    Comment actions Permalink
    Hi,

    I presume my problem is bound to short memory, but it is not clear...

    Here is my graph :

    <?xml version="1.0" encoding="UTF-8"?>
    <Graph description="" name="graph">
    <Global>
    <Metadata id="Metadata1">
    <Record name="oeccp" type="delimited">
    <Field delimiter=";" name="etsoeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="chmoeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="cgroeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="lvloeccp" nullable="true" type="numeric"/>
    <Field delimiter=";" name="c00oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c01oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c02oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c03oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c04oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c05oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c06oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c07oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c08oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c09oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c10oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c11oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c12oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c13oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c14oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c15oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="ucroeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="dcroeccp" nullable="true" type="string"/>
    <Field delimiter="\n" name="tmsoeccp" nullable="true" type="numeric"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata2">
    <Record name="obbud" type="delimited">
    <Field delimiter=";" name="etsobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="butobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="moiobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tafobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cgrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="posobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cptobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="mtdobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mtcobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="unoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="quoobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="etaobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="typobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="natobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="genobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="rolobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="infobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cgoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="pooobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ctoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tycobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="pctobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="ucrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="dcrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="udmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ddmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tmsobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="devobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ddvobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="dvmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="vprobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mddobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mdcobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="dvoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="drvobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="drmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="vrrobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mrdobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mrcobbud" nullable="true" type="numeric"/>
    <Field delimiter="\n" name="nuiobbud" nullable="true" type="numeric"/>
    </Record>
    </Metadata>
    <Metadata id="Metadata0">
    <Record name="obbud_oeccp" type="delimited">
    <Field delimiter=";" name="etsobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="butobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="moiobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tafobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cgrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="posobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cptobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="mtdobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mtcobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="unoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="quoobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="etaobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="typobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="natobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="genobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="rolobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="infobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="cgoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="pooobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ctoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tycobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="pctobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="ucrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="dcrobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="udmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ddmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="tmsobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="devobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="ddvobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="dvmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="vprobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mddobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mdcobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="dvoobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="drvobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="drmobbud" nullable="true" type="string"/>
    <Field delimiter=";" name="vrrobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mrdobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="mrcobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="nuiobbud" nullable="true" type="numeric"/>
    <Field delimiter=";" name="etsoeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="chmoeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="cgroeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="lvloeccp" nullable="true" type="numeric"/>
    <Field delimiter=";" name="c00oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c01oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c02oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c03oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c04oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c05oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c06oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c07oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c08oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c09oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c10oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c11oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c12oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c13oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c14oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="c15oeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="ucroeccp" nullable="true" type="string"/>
    <Field delimiter=";" name="dcroeccp" nullable="true" type="string"/>
    <Field delimiter="\n" name="tmsoeccp" nullable="true" type="numeric"/>
    </Record>
    </Metadata>
    <DBConnection dbDriver="org.postgresql.Driver" dbURL="jdbc:postgresql://localhost:5432/qualtfn" driverLibrary="/home/franck/devel/libs/jdbc/postgresql-8.2dev-500.jdbc3.jar" id="DBConnection0" name="qualtfn" password="xxxx" user="franck"/>
    <DBConnection dbDriver="org.postgresql.Driver" dbURL="jdbc:postgresql://localhost:5432/temporaire" driverLibrary="/home/franck/devel/libs/jdbc/postgresql-8.2dev-500.jdbc3.jar" id="DBConnection1" name="temporaire" password="xxxx" user="franck"/>
    </Global>
    <Phase number="0">
    <Node guiHeight="0" guiName="Hash Join" guiWidth="0" guiX="232" guiY="99" hashTableSize="40000" id="HASH_JOIN0" joinKey="etsobbud;cgrobbud" leftOuterJoin="true" slaveOverrideKey="etsoeccp;cgroeccp" transformClass="join_obbud_oeccp" type="HASH_JOIN"/>
    <Node dbConnection="DBConnection0" guiHeight="0" guiName="DB Input Table" guiWidth="0" guiX="38" guiY="116" id="obbud_MB" type="DB_INPUT_TABLE">
    <attr name="SQLCode">select * from obbud where butobbud = 'MB'
    and etsobbud = '04TFN' and moiobbud = '20051101'
    order by etsobbud, cgrobbud</attr>
    </Node>
    <Node dbConnection="DBConnection1" dbTable="obbud_oeccp" guiHeight="0" guiName="DB Output Table" guiWidth="0" guiX="424" guiY="170" id="obbud_oeccp" type="DB_OUTPUT_TABLE"/>
    <Node dbConnection="DBConnection0" guiHeight="0" guiName="DB Input Table" guiWidth="0" guiX="40" guiY="21" id="oeccp_STR" type="DB_INPUT_TABLE">
    <attr name="SQLCode">select * from oeccp where chmoeccp = 'STR'
    and etsoeccp = '04TFN'
    order by etsoeccp, cgroeccp</attr>
    </Node>
    <Edge fromNode="HASH_JOIN0:0" guiBendpoints="" id="Edge2" metadata="Metadata0" toNode="obbud_oeccp:0"/>
    <Edge fromNode="obbud_MB:0" guiBendpoints="" id="Edge0" metadata="Metadata2" toNode="HASH_JOIN0:0"/>
    <Edge fromNode="oeccp_STR:0" guiBendpoints="" id="Edge1" metadata="Metadata1" toNode="HASH_JOIN0:1"/>
    </Phase>
    </Graph>


    Here is the data :

    qualtfn=# SELECT count(*) from obbud qualtfn-# where butobbud = 'MB'
    qualtfn-# and etsobbud = '04TFN'
    qualtfn-# and moiobbud = '20051101';
    count
    -------
    3972
    (1 ligne)


    qualtfn=# select count(*) from oeccp where chmoeccp = 'STR'
    qualtfn-# and etsoeccp = '04TFN';
    count
    -------
    37341
    (1 ligne)

    And here is the error log :

    [WatchDog] !!! Fatal Error !!! - graph execution is aborting
    INFO [WatchDog] - [WatchDog] !!! Fatal Error !!! - graph execution is aborting
    Node HASH_JOIN0 finished with fatal error: null
    FATAL [WatchDog] - Node HASH_JOIN0 finished with fatal error: null
    [WatchDog] Interrupted node: oeccp_STR
    INFO [WatchDog] - [WatchDog] Interrupted node: oeccp_STR
    [WatchDog] Interrupted node: obbud_MB
    INFO [WatchDog] - [WatchDog] Interrupted node: obbud_MB
    [WatchDog] Interrupted node: HASH_JOIN0
    INFO [WatchDog] - [WatchDog] Interrupted node: HASH_JOIN0
    [WatchDog] Interrupted node: obbud_oeccp
    INFO [WatchDog] - [WatchDog] Interrupted node: obbud_oeccp
    ---------------------** Start of tracking Log for phase [0] **-------------------
    DEBUG [WatchDog] - ---------------------** Start of tracking Log for phase [0] **-------------------
    java.lang.InterruptedException
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:474)
    at org.jetel.graph.DirectEdge$EdgeRecordBufferPool.getFullBuffer(DirectEdge.java:352)
    at org.jetel.graph.DirectEdge.readRecord(DirectEdge.java:119)
    at org.jetel.graph.Edge.readRecord(Edge.java:238)
    at org.jetel.graph.Node.readRecord(Node.java:556)
    at org.jetel.component.DBOutputTable.runInNormalMode(DBOutputTable.java:406)
    at org.jetel.component.DBOutputTable.run(DBOutputTable.java:361)
    Failed starting graph !
    Time: 23/12/05 09:32:35
    DEBUG [WatchDog] - Time: 23/12/05 09:32:35
    Node Status Port #Records
    DEBUG [WatchDog] - Node Status Port #Records
    ---------------------------------------------------------------------------------
    DEBUG [WatchDog] - ---------------------------------------------------------------------------------
    oeccp_STR OK
    DEBUG [WatchDog] - oeccp_STR OK
    Out:0 37341
    DEBUG [WatchDog] - Out:0 37341
    obbud_MB FATAL_ERROR
    DEBUG [WatchDog] - obbud_MB FATAL_ERROR
    Out:0 4
    DEBUG [WatchDog] - Out:0 4
    HASH_JOIN0 FATAL_ERROR
    DEBUG [WatchDog] - HASH_JOIN0 FATAL_ERROR
    In:0 4
    DEBUG [WatchDog] - In:0 4
    In:1 37341
    DEBUG [WatchDog] - In:1 37341
    Out:0 0
    DEBUG [WatchDog] - Out:0 0
    obbud_oeccp ABORTED
    DEBUG [WatchDog] - obbud_oeccp ABORTED
    In:0 0
    DEBUG [WatchDog] - In:0 0
    ---------------------------------** End of Log **--------------------------------
    DEBUG [WatchDog] - ---------------------------------** End of Log **--------------------------------

    Does this help ?

    Thanks
    Franck
  • Avatar
    oldforum
    0
    Comment actions Permalink
    Hello,

    I encounter the same problem with Merge Join component. Did you resolve your problem.

    Thanks in advance

    Alex
  • Avatar
    oldforum
    0
    Comment actions Permalink
    Hello !

    There have been at least two releases of CloverGUI since the post - which one are you using ?

    Could you send your failing graph (with some data sample) to david.pavlis <at> centrum.cz

    That could help investigate the problem.

    David.
  • Avatar
    oldforum
    0
    Comment actions Permalink
    Hello !

    Can you send me the graph layout (XML file) ? It is hard to guess just from the log. It basically means that thread/component waiting for data was suddenly interrupted - should not happen normally.

    David.

Please sign in to leave a comment.

Didn't find what you were looking for?

New post