Hello,
I am using a wildcard to read all the files in a directory. The files used to be stored in subdirectories, but they now are all up one level in the same folder.
I forgot to remove the subdirectories, so after 14 hours of processing, the graph aborted with the following error:
File is unreachable: .... (is a directory)
I have already changed the wildcard from * to *.* and removed the subdirectories, but my question is, does the data reader read all files first then directories? If so, I can use the files that were already generated and not have to rerun this graph.
Thank you for your time and input,
Cory
I am using a wildcard to read all the files in a directory. The files used to be stored in subdirectories, but they now are all up one level in the same folder.
I forgot to remove the subdirectories, so after 14 hours of processing, the graph aborted with the following error:
File is unreachable: .... (is a directory)
I have already changed the wildcard from * to *.* and removed the subdirectories, but my question is, does the data reader read all files first then directories? If so, I can use the files that were already generated and not have to rerun this graph.
Thank you for your time and input,
Cory
-
Hi cvnation,
I take a look into code. Data are sorted by alphabetical order, case sensitive.
(http://docs.oracle.com/javase/6/docs/api/java/util/Arrays.html#sort(java.lang.Object[]) with String[] as parameter)
So for example my test folder is sorted like:
A.txt
NewFile.xml
NewFile.xsd
a
b
c
d
test.txt
test_nan.txt
z
Please sign in to leave a comment.
Comments 2