Orchestration Components

Google Spreadsheets Metadata

Is there a way to force Redshift to refresh the meta data associated with a Google Spreadsheet? I've changed the column structure of the spreadsheet and Matillion does not recognize...

Iterate through file in S3 Load component using specific pattern

Hi, I want to load all files with following naming sitting in a root S3 bucket. There are other files there too but I need to selecively only want the...

S3 Put Object

I'm trying to run an S3 Put Object to transfer data from an SFTP server to AWS. I'm getting the error: "socket is not established" Thanks,

"Wait" for a specified time period?

In an orchestration job, is there a way to have Matillion just wait for some specified time period, between the completion of one component and starting the next component? I'm...

context.UpdateVariable

I've read numerous places about how a variable isn't updated until a Python script is done, but it seems I'm confused at how the update happens. I have a job...

INTEGER Data Type Validation in Matillion

Hi All, I am trying to do data type validation on my source data, NULL/NOT NULL , DATE and INTEGER I am able to check the data types for NULL/NOT...

loading STL_LOAD_ERRORS data in a redshift table

Hi Experts, I am new to matillion and trying to capture the detail of of STL_LOAD_ERRORS table which is shown in the "task" tab whenever Orchestration job fails . Is...

Parameter Validation Failure: SQL Query - Timeout.

Parameter Validation Failure: SQL Query - Timeout. I have setup variables on table name so i can run through all my bigquery google analytics tables: `139139762.ga_sessions_20180705` `139139762.ga_sessions_20180704` `139139762.ga_sessions_20180703` I am...

BigQuery to Redshift How Many Rows Can I Pull

Trying to pull our bigquery google analytics data into redshift. It doesn't look like there is an option to load daily files since it deletes table and reloads every time....

Bigquery Unnest

Trying to build a bigquery into redshift query and it works in bigquery, but when I try and load it to matillion I am getting the error: No table found...