Unable to list files with whitespaces using ListFiles

melshami

• December 23, 2014 00:00

• Answered

Follow

The directory listing works ok using wildcard filter (*.csv), but it seems that it's unable to recognise the encoded URI for the file

---------------------------------------------------- Error details ------------------------------------------------------
  Component [List EOD Files:LIST_EOD_FILES] finished with status ERROR. (Out0: 0 recs)
   Failed to list ftp://user:mypass@ftp.myserver:21/EODReports/Process/*.csv
   [color=#008040] Directory listing failed
     File not found: "ftp://user:mypass@ftp.myserver:21/EODReports/Process/DailyTrans%20191220142232.csv[/color]"

• 

  melshami

  • December 30, 2014 11:34

  0

  Comment actions Permalink

  This is currently preventing me from successfully evaluating CloverETL server. Can someone from CloverETL team confirm if there is a known issue with file URL's with white spaces?
• 

  slechtaj

  • December 30, 2014 12:55

  0

  Comment actions Permalink

  Hi,
  
  coud you please tell us what CloverETL version do you use?
  
  Thanks!
• 

  melshami

  • December 30, 2014 13:05

  0

  Comment actions Permalink

  Hi
  
  I am using CloverETL Server 4.0.2.7/7
  
  Regards,
  M. Elshami
• 

  admin

  • December 31, 2014 08:12

  0

  Comment actions Permalink

  Hi M. Elshami,
  
  In general, CloverETL handles spaces in names very well. I have test exactly same file name you use on our FTP server (Pure-FTPd) and it works great. So maybe the issue lays in access rights, FTP server type, or something like that.
  
  I would suggest following to debug:
  

  
  
  • Try to run your graph with DEBUG log level (Configuring the Graph Run resp. Program Arguments) and post (please remove credentials) execution log here. Maybe we will see more information.
  
  
  • Try to run same graph on similar FTP folder not containing spaces in file names and then put there file with space and run again. This should help us to be sure that problem is really spaces in file names.
  
  
  • What FTP server do you use, please?
  
  
  • Do you have access to FTP server logs? Maybe something interesting could be found there.

  
  
  I hope this helps.
• 

  melshami

  • December 31, 2014 11:52

  0

  Comment actions Permalink

  Hi Jaroslav
  
  Thanks a lot for your reply.
  
  I've performed to runs in debug mode.
  
  a) ftp_log1_success.txt: filename with no spaces (used _ in the filename).
  b) ftp_log2_fail.txt: filename with spaces.
  
  3.What FTP server do you use, please?
  The ftp server is Microsoft Ftp Service (we deal with various numbers of OS including Solaris, RedHat and Windows). There is no single unified FTP server corporate wide.
  
  4.Do you have access to FTP server logs? Maybe something interesting could be found there.
  I don't have access to server logs. If it will help, I can arrange for a local installation of FTP service and peform more testing.
  
  Please note that, we already have our own in house built ETL engine that handles the FTP server I am currently testing against.
  
  Regards,
  M. Elshami
• 

  admin

  • December 31, 2014 12:46

  0

  Comment actions Permalink

  Hi M. Elshami,
  
  your .txt files are not attached, probably because .txt extension were not allowed. I changed forum settings, can you please attach them?
  
  Thank you!
• 

  melshami

  • December 31, 2014 13:00

  0

  Comment actions Permalink

  Here is the attachments again.

  • ftp_log1_success.txt
  • ftp_log2_fail.txt
• 

  admin

  • January 02, 2015 12:12

  0

  Comment actions Permalink

  Hi,
  
  Thank you for logs. We are investigating now but it will take few days. We will let you know when we will have results.
  
  Thank you for patience.
• 

  slechtaj

  • January 06, 2015 12:52

  0

  Comment actions Permalink

  Hi,
  
  We have been trying to reproduce the issue with the same settings (based on the log) as you. During the testing we didn’t experience any issue, so could you please provide us with a few more details – we are especially interested in your IIS version, and any further information about your environment (whether you are behind a proxy etc.)
  
  Thank you
• 

  melshami

  • January 09, 2015 15:32

  0

  Comment actions Permalink

  Thanks for getting back to me.
  
  I will perform the testing on other FTP servers and provide you with more details.
  
  Regards,
  MElshami

Please sign in to leave a comment.