Advanced

Shared Job Parameters

Do shared Job Parameters require inputs? Is there any workaround for if it is ok to leave a parameter blank and still have the shared job run? I am currently...

Queue API

We're trying to use the queue API to setup a connection to an SQS queue. The 'import queue' API reference does not work if the 'enable sqs' checkbox isn't already...

Triggering ETL from an S3 Event via AWS Lambda for multiple files.

Can I load multiple files to snowflake using "Triggering ETL from an S3 Event via AWS Lambda". I want to use single lamda function, single SQS and single Matillion job...

Array within an Array API read

Hi I had the following JSON and was able to get the script for it but now I am working on another table which has an array within an array...

Version: 1.38.6(build 313)

Has anybody seen a latency issue with data pulls from source after upgrading to 1.38.6? We had a daily job running for about 1h40min and after the upgrade bumped to...

Task History update

Is it possible to customize/add additional information to the task history?

Access S3 objects in a specific folder in an S3 bucket

Hi, I am trying to access the csv files in an S3 bucket folder. S3 bucket has many folders which I do not have access to but I do have...

Extract List of Job Variables used

Is it possible to pull a list of Job Variables used once a job is run? I know the following can list environment variables but can it be modified to...

Create and Insert log file to BQ table

Is it possible to insert a log file of a job directly to a BigQuery table or do you need to save it locally then upload it in the job?...

Creating API profiles within Matillion

Hi can we have more complete examples of pagination techniques to check for number of pages available from REST API output and retrieve data from all pages using API profile...