Advanced

Data Stagers - Support

This document provides general troubleshooting guidance for Matillion’s Data Loading components. It focuses on Orchestration jobs which use Load/Unload components to copy data from a source system into your target database. To...

Variables

Overview Note: Matillion ETL supports Environment Variables (+Automatic Variables), Job Variables and Grid Variables. For detailed information on each type, please visit the below links. For more general information on variables in...

Manage CDC

Overview Note: This feature is currently only available to AWS-hosted Matillion ETL instances CDC (Change Data Capture) allows users to synchronise their RedshiftSnowflake data with their own database, ensuring the former is...

Schemas

Overview Matillion ETL is aware that you may have multiple schemas. Each Matillion ETL environment specifies a default schema. The default schema is used by Matillion ELT in the following ways: It...

Facebook Data Model

Connection String Options Aggregate Format Authenticate As Page Auto Cache Batch Size Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Cache Tolerance Callback URL Connection Life Time Connect On...

Triggering ETL from an S3 Event via AWS Lambda

Overview This example links the arrival of a new object in S3 and automatically triggers a Matillion ETL job to load it, transform it and append the transformed data to a fact...

Recurly 3rd Party OAuth

Recurly Query Component API Key When using the Recurly Query component in Matillion ETL, users need an API Key so that Recurly can identify the program (Matillion ETL) making the API request....

Snapchat 3rd Party OAuth

Snapchat Query OAuth configuration This article is a step-by-step guide to setting up an OAuth to use with the Snapchat Query component. 1. Log in to your Snapchat account. 2. On the...

Expression Editor

​Overview The Expression Editor in Matillion ETL allows the user to create expressions in components. From the editor, users can browse from lists of available functions (dependent on platform) and data columns...

Securing Matillion ETL

Overview By default Matillion ETL users are authenticated against an internal user file however it is possible to authenticate users against an Active Directory or other LDAP directory server, turn on and...