Advanced

Create and Insert log file to BQ table

Is it possible to insert a log file of a job directly to a BigQuery table or do you need to save it locally then upload it in the job?...

Creating API profiles within Matillion

Hi can we have more complete examples of pagination techniques to check for number of pages available from REST API output and retrieve data from all pages using API profile...

Generate job documentation via API

Is it possible to generate the job documentation .html file by calling Matillion's API? This is the feature I'm referring to: https://redshiftsupport.matillion.com/customer/portal/articles/2832379?b_id=8915

Monitor long running processes

We did not see any out of the box options to monitor and notify if a job is running for more than certain time period. We have some processes which...

Source Control integration

In working through our deployment pipeline plans, we want to use multiple Matillion instances, and use an automated pipeline (in Jenkins) pull projects from one instance (dev), commit them to...

Check and reenque microbatch if needed

Hi there, is there a process in Matillion currently to check is a microbatch queue is active and re-enqueue if that queue is not active for some reason? We've seen...

Python Restful Call 404 not found

Getting a 404 with REST call. I know the credentials are ok because if I change or disable the API user property I get a credential issue so unsure why...

Export each Matillion job in individual files

We are in process of adding all our Matillion for Redshift (1.37) jobs to version control (git) repo. We currently have more than 150 Matillion jobs (Orchestration and Transformation). Taking...

Not able to connect to MySQL Database

Hi People, I have connected to MySQL database through database query component and it is validating fine as well as the connection is also established as I am able to...

Deploy Job only if it has been altered

Hi, We deploy Jobs to PROD in a programmatic way using Matillion API. We use a Git repo and we deploy from release branch. When we deploy we check the...