Newbie with record mismatch issue

dickermt

• June 25, 2008 00:00

• Answered

Follow

Hello Folks,

I am just getting started with Clover and have inherited a system that is having an issue. This was working and just stopped one day.

I have included the log entry, grf and mnt files below.

TIA...

Mike


In the logs I get:

CloverETL data record coremetricsWeekly contains less fields than target JDBC record !

The graph file:

<xml>
<Graph>
<Global>
<Metadata>
<DBConnection>
</Global>
<Phase>
<Node>
<Node>
<Edge>
</Phase>
</Graph>

and the metadata:

<xml>
<Record>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
<Field>
</Record>

[Clover] phase: 0 initialized successfully.
[WatchDog] Starting up all nodes in phase [0]
[WatchDog] INPUT1 ... started
[WatchDog] OUTPUT1 ... started
[WatchDog] Sucessfully started all nodes in phase!
[WatchDog] Execution of phase [0] successfully finished - elapsed time(sec): 1
---------------------** Start of tracking Log for phase [0] **-------------------
Time: 24/06/08 17:04:03
Node Status Port #Records
---------------------------------------------------------------------------------
INPUT1 OK
Out:0 1
OUTPUT1 FATAL_ERROR
In:0 1

• 

  dickermt

  • June 25, 2008 13:59

  0

  Comment actions Permalink

  Sorry bout that. Here is the fmt file:
  
  <?xml version="1.0" encoding="UTF-8" ?>
  <Record name="coremetricsWeekly" type="delimited">
  <Field name="WEEK_NUMBER" type="numeric" delimiter="," />
  <Field name="UNIQUE_VISITORS" type="numeric" delimiter="," />
  <Field name="FIRST_TIME_VISITORS" type="numeric" delimiter="," />
  <Field name="REPEAT_VISITORS" type="numeric" delimiter="," />
  <Field name="VISITS" type="numeric" delimiter="," />
  <Field name="FIRST_TIME_VISITS_CONV" type="numeric" delimiter="," />
  <Field name="REPEAT_VISITS_CONV" type="numeric" delimiter="," />
  <Field name="REPEAT_BUYS_CONV" type="numeric" delimiter="," />
  <Field name="EMAIL_CONV" type="numeric" delimiter="," />
  <Field name="PAID_SEARCH_CONV" type="numeric" delimiter="," />
  <Field name="HOME_PAGE_NET_SALES" type="numeric" delimiter="," />
  <Field name="HOME_PAGE_ABANDON_RATE" type="numeric" delimiter="," />
  <Field name="SHOPPING_CART_ABANDON_RATE" type="numeric" delimiter="," />
  <Field name="PROD_VIEWS_PER_VISIT" type="numeric" delimiter="," />
  <Field name="TOP_ENTRY_PAGE_1" type="string" delimiter="," />
  <Field name="TOP_ENTRY_PAGE_2" type="string" delimiter="," />
  <Field name="TOP_ENTRY_PAGE_3" type="string" delimiter="," />
  <Field name="TOP_EXIT_PAGE_1" type="string" delimiter="," />
  <Field name="TOP_EXIT_PAGE_2" type="string" delimiter="," />
  <Field name="TOP_EXIT_PAGE_3" type="string" delimiter="\n" />
  </Record>
  
  and the grf:
  <?xml version="1.0" encoding="UTF-8"?>
  <Graph name="COREMETRICS-WEEKLY">
  <Global>
  <Metadata id="InMetadata" fileURL="../metadata/coremetricsWeekly.fmt"/>
  <DBConnection id="ProfileDB" dbConfig="profileDB.properties"/>
  </Global>
  <Phase number="0">
  <Node id="INPUT1" type="DELIMITED_DATA_READER_NIO" fileURL="${data}" DataPolicy="TBS" />
  <Node id="OUTPUT1" type="DB_OUTPUT_TABLE" dbConnection="ProfileDB" dbTable="CRE_WEEKLY_COREMETRICS" maxErrors="1000"/>
  <Edge id="INEDGE1" fromNode="INPUT1:0" toNode="OUTPUT1:0" metadata="InMetadata"/>
  </Phase>
  </Graph>
  
  [/code]
• 

  jurban

  • June 25, 2008 14:05

  0

  Comment actions Permalink

  Hi,
  this looks like the structure of the database table has changed. Can you compare the structure of the table with the structure of the Clover metadata?
  
  Jaro
• 

  dickermt

  • June 25, 2008 14:18

  0

  Comment actions Permalink

  Yes, I looked at that. The column names are identical. The types are the same also. I am pasting the DDL for the table.
  
  CREATE TABLE "ODS_PRD"."CRE_WEEKLY_COREMETRICS"
  ( "WEEK_NUMBER" NUMBER(*,0) NOT NULL ENABLE,
  "UNIQUE_VISITORS" NUMBER(*,0) NOT NULL ENABLE,
  "FIRST_TIME_VISITORS" NUMBER(*,0) NOT NULL ENABLE,
  "REPEAT_VISITORS" NUMBER(*,0) NOT NULL ENABLE,
  "VISITS" NUMBER(*,0) NOT NULL ENABLE,
  "FIRST_TIME_VISITS_CONV" NUMBER(17,6) NOT NULL ENABLE,
  "REPEAT_VISITS_CONV" NUMBER(17,6) NOT NULL ENABLE,
  "REPEAT_BUYS_CONV" NUMBER(17,6) NOT NULL ENABLE,
  "EMAIL_CONV" NUMBER(17,6) NOT NULL ENABLE,
  "PAID_SEARCH_CONV" NUMBER(17,6) NOT NULL ENABLE,
  "HOME_PAGE_NET_SALES" NUMBER(17,6) NOT NULL ENABLE,
  "HOME_PAGE_ABANDON_RATE" NUMBER(17,6) NOT NULL ENABLE,
  "SHOPPING_CART_ABANDON_RATE" NUMBER(17,6) NOT NULL ENABLE,
  "PROD_VIEWS_PER_VISIT" NUMBER(22,6) NOT NULL ENABLE,
  "TOP_ENTRY_PAGE_1" VARCHAR2(255 BYTE) NOT NULL ENABLE,
  "TOP_ENTRY_PAGE_2" VARCHAR2(255 BYTE) NOT NULL ENABLE,
  "TOP_ENTRY_PAGE_3" VARCHAR2(255 BYTE) NOT NULL ENABLE,
  "TOP_EXIT_PAGE_1" VARCHAR2(255 BYTE) NOT NULL ENABLE,
  "TOP_EXIT_PAGE_2" VARCHAR2(255 BYTE) NOT NULL ENABLE,
  "TOP_EXIT_PAGE_3" VARCHAR2(255 BYTE) NOT NULL ENABLE
  )

Please sign in to leave a comment.