Advanced

Facebook Data Model

Connection String Options Aggregate Format Authenticate As Page Auto Cache Batch Size Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Cache Tolerance Callback URL Connection Life Time Connect On...

Triggering ETL from an S3 Event via AWS Lambda

Overview This example links the arrival of a new object in S3 and automatically triggers a Matillion ETL job to load it, transform it and append the transformed data to a fact...

Variables

Overview Note: Matillion ETL supports Environment Variables (+Automatic Variables), Job Variables and Grid Variables. For detailed information on each type, please visit the below links. For more general information on variables in...

Expression Editor

Overview The Expression Editor in Matillion ETL allows the user create expressions in the Calculate and Join components. From the editor, users can browse from lists of available functions (dependent on platform)...

Securing Matillion ETL

Overview By default Matillion ETL users are authenticated against an internal user file however it is possible to authenticate users against an Active Directory or other LDAP directory server, turn on and...

Type 6 Slowly Changing Dimensions Example

Overview Here we outline Matillion's approach to maintaining slowly changing dimension data using Matillion ETL by way of an extended example. Often when using Matillion ETL, a customer requires the ability to...

Manage SQS Configuration

Setting up When using a Matillion ETL as part of a larger process the best practice way to initiate an orchestration job is to use Simple Queue Service (SQS). To do this,...

Google 3rd Party OAuth Setup

For other options on authenticating Google 3rd Party services using Service Account, see here. Note: It may be that some of these services incur costs to your GCP account. Please consult the...

Schemas

Overview Matilion ETL is aware that you may have multiple schemas. Each Matillion ETL environment specifies a default schema. The default schema is used by Matillion ELT in the following ways: It...

Year-On-Year Analysis

Using Matillion for Year on Year and Month on Month analysis. Year On Year (also 'Year Over Year' or 'YOY') analysis is a popular method used to estimate the health of a...