Advanced

HubSpot incremental loads?

Is there a way to pull down incremental loads from HubSpot. According to the documentation, it seems most tables you are not able to filter on UpdatedAt, only CreatedAt. If...

Working with Matillion in weekend

Hi, During work with Matillion in weekend I receive all the time warning message like: "Waiting for server response". It's prevents me a work. It is possible that in weekend...

Query an RDS instance and place the results of that query into an parameter.

Is it possible to query an rds instance and place the results of that query into a parameter to be used in a later step?

Using variables to set sort keys

We'd like to use a variable to set the sort keys for a table that we are creating from a source MySQL DB. In some cases, we'd like to set...

Using value from Redshift as variable to a bash script

Hello! In an orchestration job I try to read a value from redshift with a SQL component, and store it in a variable, for using it as a parameter in...

Flushing the schedule queue

Sometimes a hanging query or other process in a schedule triggered workflow can cause the entire queue to overload with waiting tasks. Canceling all waiting tasks does not seem to...

Matillion ETL Monitoring, Logging and Alerting

From https://www.matillion.com/etl-for-redshift/etl-redshift/ there's a section there about: Monitoring, Logging and Alerting Matillion ETL for Redshift delivers a wide range of options around monitoring, logging and alerting – real time and...

Suggestion: Add a "Recent Projects" above "Switch Project"

Just a suggestion: I think it would be useful to add a "Recent Projects" above "Switch Project" so that users can quickly switch between their most recent projects. It is...

How to run Matillion jobs through command line ?

Is that possible to schedule the matillion jobs or transformations with bash code ?

Public schema pollution created by temporary tables

I have a ton of intermediate tables in my public schema from all the intermediate tables created by Matillion (ie "v_0000013524_0000016581"). 1) Is there something I should be doing to...