https over UniversalFileWriter

ramiro

• January 19, 2018 00:00

• Answered

Follow

Hello,

We are using the following for the File URL field, on a UniversalDataWriter component:

gzip:(https://${S3_ACCESS_KEY}:${S3_SECRET_KEY}@${S3_BUCKET}.s3.amazonaws.com/${S3_FILE})

by using https:, does that guarantee the connection is over SSL? or the http: vs https: is ignored and all are just using the standard not SSL protocol?

Please let us know, thanks!

• 

  Vladimir Barton

  • January 26, 2018 14:32

  0

  Comment actions Permalink

  Hello Ramiro,
  a recommended way of reading data from Amazon S3 in CloverETL is by using the “s3://” prefix in the particular reader component URL. By modifying your submitted URL as an example, it would look like this:
  
  

  gzip:(s3://${S3_ACCESS_KEY}:${S3_SECRET_KEY}@s3.amazonaws.com/${S3_BUCKET}/${S3_FILE})

  
  More information can be found in our documentation. Please note that the communication with Amazon S3 is always secured. In other words, using the “s3://” prefix guarantees the connection over SSL.
  If you are using an older version of CloverETL where this option does not yet exist, please let me know which version of CloverETL it is. Note: we have replaced JetS3t with Amazon SDK for connecting to S3 in version 4.2.
  Regards,
• 

  ramiro

  • February 01, 2018 23:38

  0

  Comment actions Permalink

  Perfect, I will update the url protocol to use s3 instead. We are using clover 4.2 at the moment, so this will work well for us.
  
  Thank you

Please sign in to leave a comment.