Advanced

API v1 - Tasks

Commands Below we list some common API commands for Task management in Matillion ETL by way of an example use with cURL. These commands should be immediately usable with cURL when the...

Type 6 Slowly Changing Dimensions Example

Overview Here we outline Matillion's approach to maintaining slowly changing dimension data using Matillion ETL by way of an extended example. Often when using Matillion ETL, a customer requires the ability to...

Manage SQS Configuration

Setting up When using a Matillion ETL as part of a larger process the best practice way to initiate an orchestration job is to use Simple Queue Service (SQS). To do this,...

Google 3rd Party OAuth Setup

For other options on authenticating Google 3rd Party services using Service Account, see here. Note: It may be that some of these services incur costs to your GCP account. Please consult the...

Year-On-Year Analysis

Using Matillion for Year on Year and Month on Month analysis. Year On Year (also 'Year Over Year' or 'YOY') analysis is a popular method used to estimate the health of a...

Using incron to automatically copy data to S3

Overview This is not strictly related to Matillion ETL however it is a common task to get data easily into S3 from a premise or system. This approach is especially used in...

Twitter Data Model

Connection String Options Account Id Auto Cache Batch Size Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Callback URL Connection Life Time Connect On Open Firewall Password Firewall Port...

Google Analytics Data Model

Connection String Options Auto Cache Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Connect On Open Default Filter Firewall Password Firewall Port Firewall Server Firewall Type Firewall User Initiate...

Salesforce Data Model (Connection Options)

Connection String Options All Or None API Version Auto Cache Batch Size Bulk Polling Interval Bulk Query Timeout Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Cache Tolerance Callback...

LDAP Query Data Model

Connection String Options Auth Mechanism Auto Cache Base DN Cache Connection Cache Driver Cache Location Cache Metadata Connect On Open Firewall Password Firewall Port Firewall Server Firewall Type Firewall User Follow Referrals...