Getting Started

move data between redshift instances

Is it possible to move data directly between two redshift instances (NOT schemas) or do I need to create 2 tasks; 1 to read from the source cluster and write...

Get root parent of child in Hierarchical table

I am using Matillion and Redshift, looking for a solution to get root parent of child from a Hierarchical table. Scenario explained as below: TABLE 1: (input) ChildId ParentId -------...

S3 Validation failure with memory error

Hi There, I have S3 validation failure with memory error. I am using 50MB file in m3 medium Matillion and DC1 large redshift to do an S3 copy. It has...

Redshift Weird Views

I see some weird views still remaining in the Redshift. I am thinking these views might have got created by Matillion process. I still see them hanging in there. I...

hourly ETL and getting date components as variables

Hi, We have files in S3 in the format: s3://bucket/{year}/{month}/{day}/{hour}.gz We need to load this data into matillion hourly and I'm struggling to figure out how to do this. Is...

Importing rules & mappings from csv files

Has anyone any experience of importing csv data (via JSON etc. if necessary) into Matillion rather than having to type them in from scratch? Thanks Jo

Duration - what unit of measure is this? (seconds?)

On "Orchestration" or "Transformation" jobs - there's an ability to export the DURATION to a variable. What unit of measure is this DURATION? Is it minutes, milli-seconds? Thanks

RedShift/Matillion: Create Table question - Dynamic Table Name

All, Is there any way to create a RedShift table using a table_name from a variable? Maybe using the "SQL script" widget instead of the "Create Table" one? example: person...

Prefix Object Name

We are using S3 Load in that there is one setting with name "S3 Object Prefix" in which we want to use like operator For e.g "student*dep*".* can be any...

'PermGen space' errors in Matillion

We are starting to get several errors in Matillion related to "PermGen space". A quick google search suggests this has something to do with the amount of memory allocated for...