Advanced

SQL Stored Procedures

What is the best way to translate stored procedures using Matillion for things like table creation?

JSON: Nested object too long for Redshift

Hi, I have a problem with a JSON file containing a nested object that does not fit into a VARCHAR column (> 65k). The file contains several nested objects and...

Shared Job Parameters

Do shared Job Parameters require inputs? Is there any workaround for if it is ok to leave a parameter blank and still have the shared job run? I am currently...

Queue API

We're trying to use the queue API to setup a connection to an SQS queue. The 'import queue' API reference does not work if the 'enable sqs' checkbox isn't already...

Triggering ETL from an S3 Event via AWS Lambda for multiple files.

Can I load multiple files to snowflake using "Triggering ETL from an S3 Event via AWS Lambda". I want to use single lamda function, single SQS and single Matillion job...

Array within an Array API read

Hi I had the following JSON and was able to get the script for it but now I am working on another table which has an array within an array...

Version: 1.38.6(build 313)

Has anybody seen a latency issue with data pulls from source after upgrading to 1.38.6? We had a daily job running for about 1h40min and after the upgrade bumped to...

Task History update

Is it possible to customize/add additional information to the task history?

Access S3 objects in a specific folder in an S3 bucket

Hi, I am trying to access the csv files in an S3 bucket folder. S3 bucket has many folders which I do not have access to but I do have...

Extract List of Job Variables used

Is it possible to pull a list of Job Variables used once a job is run? I know the following can list environment variables but can it be modified to...