Advanced

Version control + upgrade

I am trying to understand, how version controlling individual jobs in git will be impacted by upgrade of Matillion version to the next release version. Currently when we try to...

SNS message

How do I import a table/view into an SNS message?

Access the Matillion "Task History" data, directly?

Hi, In a webinar today, I think I heard that it is possible to access my Matillion "Task History" data, in a database. I might like to use it as...

AWS Secrets Manager

Has anyone retrieved info from the AWS Secrets Manager with Matillion? I'm looking at this to store some credentials that I need to use within Matillion processes, but not sure...

JSON format - UI vs API

Hi, Is there an intention to have only 1 JSON format regardless of we export the Job manually through Matillion's UI or we export the Job from Matillion's API? The...

Assigning Values to Variables in Matillion

Hi Community, Could you please let me know if we can achieve the following requirement using a Matillion : Req: We want to provide the flexibility of changing the variable...

Determine all jobs with given input table

Hello :) I want to determine all jobs that contain a specific table. We have a new feature and we need to change those jobs. It would be great if...

Time-out or notification, if job runs too long?

Recently, I had a scheduled Matillion job got stalled. One "Load" component that normally takes a few minutes had taken ~2 hours, when I noticed what was going on. I...

CDC using Oracle Redo/Archive logs

Hi, My requirement is i want to capture the changed data from Oracle database into Redshift. My source tables not have any timestamps, so how can i do a CDC...

How to launch Matillion jobs by event?

How to launch Matillion jobs by source file(S3) existance? I mean when source file is created used by Matillion job. JOb starts only then. What kind of solutions there are...