Hi,
I have a xml feed that I process and periodically a field or two is malformed. For example a Boolean field will contain a number. In such cases the XMLExtract component fails hard stopping the entire graph. My desired behavior would be to fail that record and provide a mechanism to stop after too many failed records. Any suggestions on an easy way to achieve this? I could make all the metadata strings and then convert it manually later, but this seems like a big pain.
Thanks.
I have a xml feed that I process and periodically a field or two is malformed. For example a Boolean field will contain a number. In such cases the XMLExtract component fails hard stopping the entire graph. My desired behavior would be to fail that record and provide a mechanism to stop after too many failed records. Any suggestions on an easy way to achieve this? I could make all the metadata strings and then convert it manually later, but this seems like a big pain.
Thanks.
-
Hello,
XmlXPathReader has dataPolicy attribute, that should allow the reader to continue when wrong record was found. But it doesn't work properly now. I've created an issue (http://bug.cloveretl.org/view.php?id=3939) with this bug, and the 2.9.2 release, which is planned for near future, should work fine. In the time being, the only workaround, is to create all fields string and try to convert the values down in the transformation flow.
Please sign in to leave a comment.
Comments 1