1) When the Universal or XML writer is done writing to a file does it close the file and open it up again when the next record/message would be required to write there?
2) Can the Universal or XML writer write to a unique file name each time? Does it require writing to a static file?
2) Can the Universal or XML writer write to a unique file name each time? Does it require writing to a static file?
-
Hello,
XMLWriter stores all records in the memory and after last one flushes everything to the file. Universal Data Writer stores in memory only some data (see Buffer's sizes) and , when the buffer is full, flushes them to the file. The file is closed after writing all data. (Unless you specify bytesPerFile or recordsPerFile attribute and wildcard '$' in your path name - see fileUrl attribute).
The name of file in every graph execution has to be the same. For changing names use parameter and set parameter value on execution.
You can also use partition, partitionFileTag, partitionKey and partitionOutFields attributes of Universal Data Writer for writing data to different files.
Please sign in to leave a comment.
Comments 1