Advanced

Generate Job Documentation

Overview Note: Job Documentation Generation is an Enterprise-only feature, meaning it is only available to customers on m4.large and m4.xlarge instances. Matillion ETL allows users to generate documentation for any given job...

Making Multiple API Queries

Matillion’s API Query Component is ideal for pulling data from a REST or SOAP API however there are cases where using a python script to make the API call may be more...

JIRA Data Model

Connection String Options Auto Cache Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Connect On Open Firewall Password Firewall Port Firewall Server Firewall Type Firewall User Include Custom Fields...

Populating an Audit Table

Auditing Runtime Data Each component can make runtime information available. In this example, we are interested in how long an S3 load takes to complete and we want to show how to...

Data Privacy with the Matillion ETL PaaS

Overview When you start Matillion ETL you are launching a PaaS product (Platform as a Service) rather than SaaS (Software as a Service). The look and feel of using PaaS and SaaS...

Paging with the API Query Component

This document builds on an earlier article "Writing API Profiles", and describes how to include paging in an API Profile that you have created. Other documents in this series: Using Parameters With...

Matillion Data Quality Framework

Background The term “data quality” is very broad, and typically has a dual meaning: Data that is complete, accurate and relevant A set of processes to achieve such a state We’ll focus...

LDAP Integration

Overview Matillion supports 3 authentication models – NONE, INTERNAL (default) and EXTERNAL By default (from v1.25.1) users in Matillion are authenticated against an INTERNAL user file however it is possible to authenticate...

ServiceNow Data Model

Connection String Options Auto Cache Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Connect On Open Firewall Password Firewall Port Firewall Server Firewall Type Firewall User Initiate OAuth Instance...

PayPal Data Model

Connection String Options Auto Cache Cache Connection Cache Driver Cache Location Cache Metadata Cache Query Result Callback URL Connect On Open Firewall Password Firewall Port Firewall Server Firewall Type Firewall User Initiate...