Orchestration Components

How to read the Failure message from Tranformation Job?

I’ve a requirement to send failure email notification through SNS Message component. In the email message I’d like to include reason of the failure. I’ve created Orchestration job and within...

special date load for snowflake

Is there a way to achieve this from the Orchestration job / s3 load component? As a workaround, you could convert the special date or timestamp to a SQL NULL...

Stored Procedure

Is there a way we can call stored procedure created in Redhsift using Python Script in Matillion?

Data Transfer Component gzip source

Source data is .gz file compression type. When set unzip file property to yes, the job fails. If I do not, it succeeds. Can Data Transfer Component only handle .zip...

Azure Blob Storage Load

I am using Azure Blob Storage Load to load the data from csv file in blob to Snow flake table 1. I am not able to truncate and load the...

json bulk load from s3

Hi, I have 60k JSON files in the s3 folder I want to load s3 to redshift, What is the quickest way to load the files from s3? Currently, I...

Scheduling jobs -Load Run time inconsistency

I need assistance for the current situation I am going through.Please see below. I have few workflow jobs in stage and prod mapped to same data source connection(Pulling from oracle)...

Bulk RDS output to MySQL boolean to int

I am using the RDS bulk output orchestration module to copy a table from Snowflake to MySQL. However the boolean true/false values are getting created in the new table (created...

Database Query component failing when running concurrently inside a transaction.

I have an Orchestration Job that runs multiple times concurrently within a transaction, it contains a Database Query component to copy data into Redshift. For running that I'm using a...

Missing the Nested Data Load Component

Hey there; I'm not sure if i'm missing something, but the 'Nested Data Load' component is not showing up in any of my environments. Is there a certain limitation that...