Customer Portal

BufferUnderflowException while transforming json data

  1. CloverDX Customer Portal
  2. Forum
  3. BufferUnderflowException while transforming json data
Avatar
madan_clover3
  • Answered
Follow
Hi,

I am trying to transform json source data into app specific format. The transformation is working fine for many json files. But for one particular json file(json is simple, but data file is about 16MB), I am seeing java.nio.BufferUnderflowException. I have seen this issue was reported in previous versions, but happening again in my case. Please some one post the suggestions.

I am using clover etl open source engine version 5.1.1. Configuring and running transformation using Java language.

Below is the Transformation Graph Configuration : 

INFO  18 Oct 2020 15:29:28.444 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1008 - *** TRANSFORMATION GRAPH CONFIGURATION ***

INFO  18 Oct 2020 15:29:28.444 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1010 - --- Phase [1] ---
INFO  18 Oct 2020 15:29:28.444 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1011 - 	... nodes ...
INFO  18 Oct 2020 15:29:28.445 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	2AJSONALL_jsonextract_1 :  phase: 1
INFO  18 Oct 2020 15:29:28.445 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	2AJSONALL_XmlReformat_2 :  phase: 1
INFO  18 Oct 2020 15:29:28.445 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_det_2a_b2b_pre_join_sort_node4 :  phase: 1
INFO  18 Oct 2020 15:29:28.445 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_det_2a_b2b_MergeJoin_3 :  phase: 1
INFO  18 Oct 2020 15:29:28.446 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_head_pre_join_sort_node6 :  phase: 1
INFO  18 Oct 2020 15:29:28.446 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_head_MergeJoin_5 :  phase: 1
INFO  18 Oct 2020 15:29:28.446 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_inv_pre_join_sort_node8 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_inv_MergeJoin_7 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_itm_pre_join_sort_node10 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_itm_MergeJoin_9 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_itm_det_SortNode_11 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_itm_SortNode_12 :  phase: 1
INFO  18 Oct 2020 15:29:28.447 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_inv_SortNode_13 :  phase: 1
INFO  18 Oct 2020 15:29:28.448 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2b_head_SortNode_14 :  phase: 1
INFO  18 Oct 2020 15:29:28.448 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_det_2a_b2ba_pre_join_sort_node16 :  phase: 1
INFO  18 Oct 2020 15:29:28.448 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_det_2a_b2ba_MergeJoin_15 :  phase: 1
INFO  18 Oct 2020 15:29:28.448 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_head_pre_join_sort_node18 :  phase: 1
INFO  18 Oct 2020 15:29:28.448 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_head_MergeJoin_17 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_inv_pre_join_sort_node20 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_inv_MergeJoin_19 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_itm_pre_join_sort_node22 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_itm_MergeJoin_21 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_itm_det_SortNode_23 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_itm_SortNode_24 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_inv_SortNode_25 :  phase: 1
INFO  18 Oct 2020 15:29:28.449 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	b2ba_head_SortNode_26 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_details_pre_join_sort_node28 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_details_MergeJoin_27 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_head_pre_join_sort_node30 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_head_MergeJoin_29 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_nt_pre_join_sort_node32 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_nt_MergeJoin_31 :  phase: 1
INFO  18 Oct 2020 15:29:28.450 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_itms_pre_join_sort_node34 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_itms_MergeJoin_33 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_itm_det_SortNode_35 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_itms_SortNode_36 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_nt_SortNode_37 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdn_head_SortNode_38 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_cr_pre_join_sort_node40 :  phase: 1
INFO  18 Oct 2020 15:29:28.451 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_cr_MergeJoin_39 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_head_pre_join_sort_node42 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_head_MergeJoin_41 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_doclist_SortNode_43 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isd_head_SortNode_44 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_details_cdna_pre_join_sort_node46 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	item_details_cdna_MergeJoin_45 :  phase: 1
INFO  18 Oct 2020 15:29:28.452 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_head_pre_join_sort_node48 :  phase: 1
INFO  18 Oct 2020 15:29:28.453 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_head_MergeJoin_47 :  phase: 1
INFO  18 Oct 2020 15:29:28.453 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_nt_pre_join_sort_node50 :  phase: 1
INFO  18 Oct 2020 15:29:28.453 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_nt_MergeJoin_49 :  phase: 1
INFO  18 Oct 2020 15:29:28.453 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_itms_pre_join_sort_node52 :  phase: 1
INFO  18 Oct 2020 15:29:28.453 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_itms_MergeJoin_51 :  phase: 1
INFO  18 Oct 2020 15:29:28.454 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_itm_det_SortNode_53 :  phase: 1
INFO  18 Oct 2020 15:29:28.454 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_itms_SortNode_54 :  phase: 1
INFO  18 Oct 2020 15:29:28.454 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_nt_SortNode_55 :  phase: 1
INFO  18 Oct 2020 15:29:28.454 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	cdna_head_SortNode_56 :  phase: 1
INFO  18 Oct 2020 15:29:28.454 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_cr_pre_join_sort_node58 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_cr_MergeJoin_57 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_head_pre_join_sort_node60 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_head_MergeJoin_59 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_doclist_SortNode_61 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	isda_head_SortNode_62 :  phase: 1
INFO  18 Oct 2020 15:29:28.455 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impg_det_pre_join_sort_node64 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impg_det_MergeJoin_63 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impg_child_SortNode_65 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impgsez_det_pre_join_sort_node67 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impgsez_det_MergeJoin_66 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	impgsez_child_SortNode_68 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	defaulttransformnode_69 :  phase: 1
INFO  18 Oct 2020 15:29:28.456 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1013 - 	2AJSONALL_ExtXmlWriter_70 :  phase: 1
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1015 - 	... edges ...
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_json_object_level_0_out_edge_1 type: buffered
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_b2b_level_1_out_edge_2 type: buffered
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_inv_level_2_out_edge_3 type: buffered
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itms_level_3_out_edge_4 type: buffered
INFO  18 Oct 2020 15:29:28.457 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itm_det_level_4_out_edge_5 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_b2ba_level_1_out_edge_6 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_inv_level_2_out_edge_7 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itms_level_3_out_edge_8 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itm_det_level_4_out_edge_9 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_cdn_level_1_out_edge_10 type: buffered
INFO  18 Oct 2020 15:29:28.458 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_nt_level_2_out_edge_11 type: buffered
INFO  18 Oct 2020 15:29:28.459 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itms_level_3_out_edge_12 type: buffered
INFO  18 Oct 2020 15:29:28.459 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itm_det_level_4_out_edge_13 type: buffered
INFO  18 Oct 2020 15:29:28.459 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_isd_level_1_out_edge_14 type: buffered
INFO  18 Oct 2020 15:29:28.459 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_doclist_level_2_out_edge_15 type: buffered
INFO  18 Oct 2020 15:29:28.460 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_cdna_level_1_out_edge_16 type: buffered
INFO  18 Oct 2020 15:29:28.460 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_nt_level_2_out_edge_17 type: buffered
INFO  18 Oct 2020 15:29:28.460 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itms_level_3_out_edge_18 type: buffered
INFO  18 Oct 2020 15:29:28.460 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_itm_det_level_4_out_edge_19 type: buffered
INFO  18 Oct 2020 15:29:28.460 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_isda_level_1_out_edge_20 type: buffered
INFO  18 Oct 2020 15:29:28.461 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_doclist_level_2_out_edge_21 type: buffered
INFO  18 Oct 2020 15:29:28.461 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_tds_level_1_out_edge_22 type: buffered
INFO  18 Oct 2020 15:29:28.461 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_errors_level_1_out_edge_23 type: buffered
INFO  18 Oct 2020 15:29:28.461 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_impg_level_1_out_edge_24 type: buffered
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	JsonExtract_impgsez_level_1_out_edge_25 type: buffered
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_item_det_2a_b2b_out_edge_26 type: direct
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_item_det_2a_b2ba_out_edge_27 type: direct
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_item_details_out_edge_28 type: direct
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isd_cr_out_edge_29 type: direct
INFO  18 Oct 2020 15:29:28.462 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_item_details_cdna_out_edge_30 type: direct
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isda_cr_out_edge_31 type: direct
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_trn_api_det_out_edge_32 type: buffered
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_impg_det_out_edge_33 type: direct
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_impgsez_det_out_edge_34 type: direct
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2b_head_out_edge_35 type: direct
INFO  18 Oct 2020 15:29:28.463 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2b_inv_out_edge_36 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2b_itm_out_edge_37 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2b_itm_det_out_edge_38 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2ba_head_out_edge_39 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2ba_inv_out_edge_40 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2ba_itm_out_edge_41 type: direct
INFO  18 Oct 2020 15:29:28.464 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_b2ba_itm_det_out_edge_42 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdn_head_out_edge_43 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdn_nt_out_edge_44 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdn_itms_out_edge_45 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdn_itm_det_out_edge_46 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isd_head_out_edge_47 type: direct
INFO  18 Oct 2020 15:29:28.465 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isd_doclist_out_edge_48 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdna_head_out_edge_49 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdna_nt_out_edge_50 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdna_itms_out_edge_51 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_cdna_itm_det_out_edge_52 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isda_head_out_edge_53 type: direct
INFO  18 Oct 2020 15:29:28.466 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_isda_doclist_out_edge_54 type: direct
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_tds_out_edge_55 type: buffered
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_error_out_edge_56 type: buffered
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_impg_child_out_edge_57 type: direct
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	XmlReformat_impgsez_child_out_edge_58 type: direct
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_det_2a_b2b_pre_join_sort_out_edge_59 type: buffered
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_head_pre_join_sort_out_edge_60 type: buffered
INFO  18 Oct 2020 15:29:28.467 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_inv_pre_join_sort_out_edge_61 type: buffered
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_itm_pre_join_sort_out_edge_62 type: buffered
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_itm_det_SortEdge_63 type: buffered
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_itm_MergedDataRecEdge_64 type: direct
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_itm_SortEdge_65 type: buffered
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_inv_MergedDataRecEdge_66 type: direct
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_inv_SortEdge_67 type: buffered
INFO  18 Oct 2020 15:29:28.468 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_head_MergedDataRecEdge_68 type: direct
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2b_head_SortEdge_69 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_det_2a_b2b_MergedDataRecEdge_70 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_det_2a_b2ba_pre_join_sort_out_edge_71 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_head_pre_join_sort_out_edge_72 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_inv_pre_join_sort_out_edge_73 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_itm_pre_join_sort_out_edge_74 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_itm_det_SortEdge_75 type: buffered
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_itm_MergedDataRecEdge_76 type: direct
INFO  18 Oct 2020 15:29:28.469 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_itm_SortEdge_77 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_inv_MergedDataRecEdge_78 type: direct
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_inv_SortEdge_79 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_head_MergedDataRecEdge_80 type: direct
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	b2ba_head_SortEdge_81 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_det_2a_b2ba_MergedDataRecEdge_82 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_details_pre_join_sort_out_edge_83 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_head_pre_join_sort_out_edge_84 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_nt_pre_join_sort_out_edge_85 type: buffered
INFO  18 Oct 2020 15:29:28.470 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_itms_pre_join_sort_out_edge_86 type: buffered
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_itm_det_SortEdge_87 type: buffered
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_itms_MergedDataRecEdge_88 type: direct
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_itms_SortEdge_89 type: buffered
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_nt_MergedDataRecEdge_90 type: direct
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_nt_SortEdge_91 type: buffered
INFO  18 Oct 2020 15:29:28.471 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_head_MergedDataRecEdge_92 type: direct
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdn_head_SortEdge_93 type: buffered
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_details_MergedDataRecEdge_94 type: buffered
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_cr_pre_join_sort_out_edge_95 type: buffered
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_head_pre_join_sort_out_edge_96 type: buffered
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_doclist_SortEdge_97 type: buffered
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_head_MergedDataRecEdge_98 type: direct
INFO  18 Oct 2020 15:29:28.472 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_head_SortEdge_99 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_cr_MergedDataRecEdge_100 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_details_cdna_pre_join_sort_out_edge_101 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_head_pre_join_sort_out_edge_102 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_nt_pre_join_sort_out_edge_103 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_itms_pre_join_sort_out_edge_104 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_itm_det_SortEdge_105 type: buffered
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_itms_MergedDataRecEdge_106 type: direct
INFO  18 Oct 2020 15:29:28.473 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_itms_SortEdge_107 type: buffered
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_nt_MergedDataRecEdge_108 type: direct
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_nt_SortEdge_109 type: buffered
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_head_MergedDataRecEdge_110 type: direct
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	cdna_head_SortEdge_111 type: buffered
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_details_cdna_MergedDataRecEdge_112 type: buffered
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_cr_pre_join_sort_out_edge_113 type: buffered
INFO  18 Oct 2020 15:29:28.474 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_head_pre_join_sort_out_edge_114 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_doclist_SortEdge_115 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_head_MergedDataRecEdge_116 type: direct
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_head_SortEdge_117 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isda_cr_MergedDataRecEdge_118 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impg_det_pre_join_sort_out_edge_119 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impg_child_SortEdge_120 type: buffered
INFO  18 Oct 2020 15:29:28.475 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impg_det_MergedDataRecEdge_121 type: buffered
INFO  18 Oct 2020 15:29:28.476 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impgsez_det_pre_join_sort_out_edge_122 type: buffered
INFO  18 Oct 2020 15:29:28.476 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impgsez_child_SortEdge_123 type: buffered
INFO  18 Oct 2020 15:29:28.476 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impgsez_det_MergedDataRecEdge_124 type: buffered
INFO  18 Oct 2020 15:29:28.476 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_det_2a_b2b_default_out_edge_125 type: buffered
INFO  18 Oct 2020 15:29:28.476 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	item_details_default_out_edge_127 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	isd_cr_default_out_edge_128 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	trn_api_det_default_out_edge_131 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impg_det_default_out_edge_132 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	impgsez_det_default_out_edge_133 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1017 - 	tds_default_out_edge_134 type: buffered
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1020 - --- end phase ---
INFO  18 Oct 2020 15:29:28.477 [main] org.jetel.graph.TransformationGraph.dumpGraphConfiguration 1022 - *** END OF GRAPH LIST ***



Stack Trace : 

2020-10-18 15:29:37 ERROR org.jetel.util.ExceptionUtils - Error details:
org.jetel.exception.JetelRuntimeException: Component [b2b_head_MergeJoin_5] finished with status ERROR. (In0: 551 recs, In1: 30396 recs, Out0: 30394 recs)
	at org.jetel.graph.Node.createNodeException(Node.java:653)
	at org.jetel.graph.Node.run(Node.java:619)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.nio.BufferUnderflowException
	at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:641)
	at java.base/java.nio.DirectByteBuffer.get(DirectByteBuffer.java:261)
	at org.jetel.util.bytes.DynamicCloverBuffer.get(DynamicCloverBuffer.java:538)
	at org.jetel.util.bytes.ByteBufferUtils.decodeLength(ByteBufferUtils.java:271)
	at org.jetel.data.StringDataField.deserialize(StringDataField.java:367)
	at org.jetel.data.DataRecordImpl.deserialize(DataRecordImpl.java:287)
	at org.jetel.data.reader.SlaveReaderDup.next(SlaveReaderDup.java:153)
	at org.jetel.component.MergeJoin.flushMin(MergeJoin.java:421)
	at org.jetel.component.MergeJoin.execute(MergeJoin.java:472)
	at org.jetel.graph.Node.run(Node.java:579)

Comments 1

Sort by Date Votes
  • Avatar
    admin
    0
    Comment actions Permalink
    Hi,

    This seems to be an already discovered data issue that has been dealt with in newer versions of CloverDX. However, the improvement has been released with version 5.6.1 and this version doesn't come with the Open Source engine anymore. If you are interested in testing your data on the newer version, you can download a fully functional CloverDX Designer, which you can use for 45 days on a free trial basis. If you would like to evaluate the CloverDX Designer, please, click here.

    Unfortunately, there is no way I could reproduce your issue without having your exact data files. Therefore, I am also not able to provide any suitable workaround. Anyway, in a situation like this, there are a couple of things I would check/tested:
    1. Phases - in data issues (big files, subsequent transformations, and merging), it is usually helpful to move the next action to a different phase. So far, I can see that you have everything in phase 1.
    2. Edge types - you can try testing other types of edge. For more information about edge types please see the following page https://doc.cloverdx.com/latest/designer/types-of-edges.html
    3. Delimiters - Sometimes data issues are caused by the sudden appearance of an unexpected delimiter in a file. This is also worth checking.
    I am sorry that I could not be of better assistance. Thanks for understanding and have a nice day, Eva

Please sign in to leave a comment.

Didn't find what you were looking for?

New post