Cant use variables in s3 file iterator or other components
I am trying to use a environment variable to assign Input URL instead of hardcoded or drop down selection of folder for file iterator. However, I don't see an option to use variable and if I use $(variable).. it says url not accessible. I even tried to run thinking it might pick up during runtime but was unsuccessful. Has anyone been facing these problem with several orchestration components ? This severely restricts the use of matillion for automation ETL.
2 Community Answers
Ian Funnell —
It is possible to use a variable here. I think you might just be missing a couple of things:
Use curly braces, not parentheses, when naming the variable
Give the variable a default value for Matillion to use during vallidation
E.g. if you have a variable called export_bucket with a default value of the name of one of your buckets (with no “s3” prefix), then you could set the Input Data URL of an S3 File Iterator to: