Transformation Components

Database Query Concurrency max value

Hi, how I can increase the "Database Query" component's property "Concurrency"? Currently it only allows a maximum number of 16 and if I input more than that, it shows the...

How to start with a custom SELECT statement?

I'm new to Matillion. I've started with an Orchestration job that stages some data from my source. Now, say I want to create a Transformation job, and start it with...

Missing Examples?

I've noticed that a number of the articles about Transformation Components (and Orchestration Components, too) don't include the examples that are referenced. Map Values, Table Input, Generate Sequence, S3 Load,...

Error creating view: ERROR: relation "XXX" does not exist

I'm periodically seeing transform components invalidate with this error message. Sometimes I can clear it by rebuilding tables and sometimes by removing connections and recreating them. Does anyone know the...

Transform component leaves view artifacts

I have a transform component set up that contains a SQL Source query going to a Rewrite Table component. The source query is basically a union on two tables, and...

Export row count

Example. I want to know the total number of rows in a physical table after my transformations is done. Iam using a table update component where I export the row...

Global Variable in Calculatr

Hi, we're running Matillion ETL for Redshift Version: 1.24.6 (build 55) and I'm trying to use a variable in the expression box of a Calculator component. i defined a simple...

pattern for incremental fact table load by day

I would like to load a fact table 1 day at a time, from the latest day of data in the fact table until the current day. What is the...

URL does not point to an accessible S3 bucket.

Experiencing issue in accessing the s3 URL. when i enter the s3 URL, i get an error "That URL does not point to an accessible S3 bucket." Not sure what's...

Include task information in SNS message

Hi. Is it possible to include systeminformation or taskinforamtion in the SNS message? Perhaps if a component or transformation job fails, the error message in the tasks message flow could...