Orchestration Components

What are the native types used by Matillion when creating a table?

What are the native Redshift types used when Matillion creates a table? The documentation for the component links to the Redshift documentation for each type but there are several potential...

Database Query - After data loading, DateTime fields in RedShift and source tables, are not matching

Hi, I'm using Database Query component to load a MySQL database into a Red-Shift schema. I noticed 5.5 hours (0530) difference in Date-Time fields, when comparing the source data and...

Add zstd compression support

Can you please add zstd compression support for Create table component?

Export stl_loaderrors to variable

Hi. We are using slack to deliver status messages from matillion. We have a source that can be somewhat unrealiable and we get a loaderror from redshift sometimes. In order...

S3 put object

Hi , I am new to Matillion, I am trying to download the sample data from http:/data.dft.gov.uk/road-accidents-safety-data/RoadSafetyData_Vehicles_2015.zip put into s3 bucket. I am getting the following error message "protocol =...

Increasing S3 Load Columns Limit

Hi all, I was using the S3 Load Generator Components on a S3 gzipped CSV when this error occurs: Exception caught whilst getting sample: java.lang.ArrayIndexOutOfBoundsException - 512 Hint: Number of...

S3 Access from Load Component

We are using an RDS Query component and getting an error stating that the component needs write access to an S3 bucket. We've followed the procedure discussed here: https://redshiftsupport.matillion.com/customer/portal/questions/16820194-accessing-s3-bucket And...

Available memory for Python component

Hi. I have been experimenting with the Python component to get data from an API. Sometimes I get to much data and get an out of memory message. What is...

Cant use variables in s3 file iterator or other components

Hi Everyone, I am trying to use a environment variable to assign Input URL instead of hardcoded or drop down selection of folder for file iterator. However, I don't see...

Database Query Component - customize target table

I'd like to load all the tables from a MySQL DB to Redshift. I don't see how I can use the Database Query Component to do all of the tables...