Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Cant use variables in s3 file iterator or other components

Hi Everyone,

I am trying to use a environment variable to assign Input URL instead of hardcoded or drop down selection of folder for file iterator. However, I don't see an option to use variable and if I use $(variable).. it says url not accessible. I even tried to run thinking it might pick up during runtime but was unsuccessful. Has anyone been facing these problem with several orchestration components ? This severely restricts the use of matillion for automation ETL.

Thanks,
Deepesh

2 Community Answers

Matillion Agent  

Ian Funnell —

Hi Deepesh,

It is possible to use a variable here. I think you might just be missing a couple of things:

  1. Use curly braces, not parentheses, when naming the variable
  2. Give the variable a default value for Matillion to use during vallidation

E.g. if you have a variable called export_bucket with a default value of the name of one of your buckets (with no “s3” prefix), then you could set the Input Data URL of an S3 File Iterator to:

s3://${export_bucket}

Best regards,
Ian


Deepesh Sharma —

Thanks Ian .. works :)

Post Your Community Answer

To add an answer please login