Advanced

Transfer the data from source redshfit DB to another redshfit DB.

I want to transfer the data from source redshfit DB to another redshfit DB. would you please let me know how to do it in Matillion ? Those 2 redshfit...

Recommended method to create surrogate keys

Hello, Is there a recommended way to create surrogate keys that increment by 1 on a multi-node redshift cluster? I've tried the identity column but it does not seem to...

how to pass Matillion's "Environment Variables" to python application

Pass Matillion's "Environment Variables" to my python application which is run in Bash Script Component ? for example I have this command shell command ("python test.py") in Bash Script Component....

How to cancle multiple tasks?

We have a setup where a task ifs more effective if it is running with smaller slices. Therefor we start the tasks every 5 min. A usual run takes 2...

Best ETL design for Redshift OLAP with ORACLE as source

How to extract real time data from oracle database and load into Amazon redshift OLAP with required transformations using Matillion ?

API Profiles & Environment Variables

I've successfully set up a job utilizing an API profile to pull data from a custom API. Now I'd like to configure my API call on the fly using environment...

Passing variables back from jobs

I am having trouble with passing variables around when using 'context'. I am able to pass the variable between components when going into sub component, but I don't seem to...

wait fors

I'd like to gate orchestration and transformation jobs to wait for specific data sets to have landed before running. I'm not sure how to represent this in Matillion though. In...

HubSpot incremental loads?

Is there a way to pull down incremental loads from HubSpot. According to the documentation, it seems most tables you are not able to filter on UpdatedAt, only CreatedAt. If...

Working with Matillion in weekend

Hi, During work with Matillion in weekend I receive all the time warning message like: "Waiting for server response". It's prevents me a work. It is possible that in weekend...