Transformation Components

Stack overflow error in 'SQL Component'

Hi, I have a singe SQL query which left joins 14 tables together. It outputs result in 26 columns. When I run the job, SQL Component which contains this query...

Filter IN / NOT IN

Hi, would be great to add IN / NOT IN support for filter component. Better yet, please allow free-style filter expressions without being limited to a predefined list of comparison...

Transpose rows component

Hi, I saw the tutorial for pivoting tables that uses Transpose rows followed by Split. The issue with this approach is that it is highly inefficient and does not scale...

How to see SQL ran by components?

Hi, I am exploring the Matillion functionality. One thing that is not obvious to me – how do I debug the actual SQL ran by the Matillion components? I know I...

Matillion not being able to access UDF

Hi everyone, I have created a number of UDF on Redshift but it seems like they cannot be called in Matillion. Error being the typical one: ERROR: function FUNCTION_NAME(bigint) does...

Database Query Concurrency max value

Hi, how I can increase the "Database Query" component's property "Concurrency"? Currently it only allows a maximum number of 16 and if I input more than that, it shows the...

How to start with a custom SELECT statement?

I'm new to Matillion. I've started with an Orchestration job that stages some data from my source. Now, say I want to create a Transformation job, and start it with...

Missing Examples?

I've noticed that a number of the articles about Transformation Components (and Orchestration Components, too) don't include the examples that are referenced. Map Values, Table Input, Generate Sequence, S3 Load,...

Error creating view: ERROR: relation "XXX" does not exist

I'm periodically seeing transform components invalidate with this error message. Sometimes I can clear it by rebuilding tables and sometimes by removing connections and recreating them. Does anyone know the...

Transform component leaves view artifacts

I have a transform component set up that contains a SQL Source query going to a Rewrite Table component. The source query is basically a union on two tables, and...