Hi,
I'm implementing a custom CloverETL source node, which receives some data, creates a record and writes that record to the output ports. Then, this component waits for more data, that may or may not come. The thing is that the record I'm writing to the output ports is not "flushed" so is not reaching the other nodes. How can I implement this behaviour and each record I'm writing to the output ports is processed by the other components immediately? I suppose it should be similar to JMS reader node. I think calling "eof()" in the output ports is not an option because the record is processed but the execution of the graph ends.
Thanks in advance,
Franco
I'm implementing a custom CloverETL source node, which receives some data, creates a record and writes that record to the output ports. Then, this component waits for more data, that may or may not come. The thing is that the record I'm writing to the output ports is not "flushed" so is not reaching the other nodes. How can I implement this behaviour and each record I'm writing to the output ports is processed by the other components immediately? I suppose it should be similar to JMS reader node. I think calling "eof()" in the output ports is not an option because the record is processed but the execution of the graph ends.
Thanks in advance,
Franco
-
Hello Franco,
there is no way (except sending eof) to force the edge to flush buffered records.
But you can use direct fast propagate edge (edgeType="directFastPropagate") after your node. Such edge sends the serialized record to its end immediately (see Types of Edges).
Please sign in to leave a comment.
Comments 2