Orchestration Components

File Iterator &Filter Regex

I have multiple file getting uploaded to the same folder in s3 . I would like to process all files prefixed with "Client_1". I have a variable and I'm using...

Passing variables into Bash script

Hi, I have Loop Iteration followed with Bash script, based on iterations i have to pass the value into bash script. Exp: For First iteration the value 1 should be...

Assign values into Grid Variables

Using python component, how can I assign a set of list/values into grid variables?

Errors from Load / Query Components

Hi, I'm getting some cryptic errors on some load- / query-type components. They seem to occur pretty randomly: I will get these errors during one scheduled "refresh," but not on...

Salesforce Query

I have an ETL that is using the salesforce query component. As i watch data being staged, it appears as if records are being staged roughly 5K rows at a...

Renaming files using Amzon CLI script object

Hi ! Can anyone help solve this ? I have an S3 bucket with two folders. S3://BKP and S3://DIMS. I have to rename files in a way as shown below...

File Iterator

Hello, I am using a file iterator with the put component. I see there is a recursive property that I can use to control whether or not I want to...

RDS component

How to conncet with the oracle db using the drivers...my data is in oracle and i want to load it into biqquery..so please help me to connect to it as...

Put Object

I am aware of the Put object and how it can be used to unzip and load a file into Matillion. Is there a way to have the Put object...

Big query to SFTP component?

Does Matillion bigquery ETL has a component similar to Cloud Storage Put Object, but does the functionality in opposite direction moving files from cloud storage/bigquery to SFTP. Also any SMTP...