Hi,
I am new to Clover, and I am just beginning experimenting...
I have two questions :
1) If I want to copy from one db to another one, with exactly the same tables.
Can I simply create two nodes (DB_INPUT_TABLE and DB_OUTPUT_TABLE) and an Edge between them, or should I put a SimpleCopy component inbetween ?
2) I have tried first solution (two nodes bound directly) and get this error :
INFO: [WatchDog] Sucessfully started all nodes in phase!
Exception in thread "OUTPUT" java.lang.NullPointerException
at org.jetel.database.SQLUtil.getFieldTypes(Unknown Source)
at org.jetel.component.DBOutputTable.run(Unknown Source)
My metadata is <Metadata id="InMetadata" dbConnection="Postgres-DB" sqlQuery="select * from mytable where 1=0"/>
and edge is :
<Edge id="INEDGE" fromNode="INPUT:0" toNode="OUTPUT:0" metadata="InMetadata"/>
Both tables share the same metadata (their are created with the same DDL in two databases on the same postgresql cluster).
What does this exception mean ?
Thanks in advance,
Franck
I am new to Clover, and I am just beginning experimenting...
I have two questions :
1) If I want to copy from one db to another one, with exactly the same tables.
Can I simply create two nodes (DB_INPUT_TABLE and DB_OUTPUT_TABLE) and an Edge between them, or should I put a SimpleCopy component inbetween ?
2) I have tried first solution (two nodes bound directly) and get this error :
INFO: [WatchDog] Sucessfully started all nodes in phase!
Exception in thread "OUTPUT" java.lang.NullPointerException
at org.jetel.database.SQLUtil.getFieldTypes(Unknown Source)
at org.jetel.component.DBOutputTable.run(Unknown Source)
My metadata is <Metadata id="InMetadata" dbConnection="Postgres-DB" sqlQuery="select * from mytable where 1=0"/>
and edge is :
<Edge id="INEDGE" fromNode="INPUT:0" toNode="OUTPUT:0" metadata="InMetadata"/>
Both tables share the same metadata (their are created with the same DDL in two databases on the same postgresql cluster).
What does this exception mean ?
Thanks in advance,
Franck
-
Hello Franck !
Overall, it should be possible to directly connect DBInputTable and DBOutputTable.
Said that, I am not sure, it looks like the metadata extracted by the "select *" query somehow does not match the target table.
Try two things:
a) in your SQL query, specify list of fields you are going to extract. Make sure they are in the same order as in the target database.
b) try to use org.jetel.database.AnalyzeDB utility (or CloverGUI) to extract clover style metadata and use them in this graph.
If time permits, I will try to investigate it a bit more.
David. -
Hello Franck !
If you just use "dbTable" attribute/parameter of the DB_OUTPUT_TABLE and specify the name of your output table, Clover will try to assemble its own insert statement based on the input metadata.
(Leave out "dbFields" and "sqlQuery")
The problem is that with some databases and JDBC drivers versions this approach might not work.
David. -
Hello David,
and thanks for the quick reply !
I have done what you suggested :
- run AnalyseDB
- define metadata using the generated xml file
- try different select / insert combination
Result is that metadata with "select * from mytable" works, as well as with an xml file.
"Select * from mytable" in DB_INPUT_TABLE component is fine too.
The point is in DB_OUTPUT_TABLE : to make it work, I had to mention each field in dbFields and cloverFields attributes, and to put an SQLCode with as many '?' placeholders. Ommiting dbFields or cloverFields fails.
Is this expected behaviour or is there is simpler way ? (I just want to duplicate a table, mentionning each field name twice (dbFields, cloverFields) and counting the number of matching '?' is cumbersome...
Any thought ?
Franck
Please sign in to leave a comment.
Comments 6