Advanced

Matillion pattern to flatten a parent-child hierarchy?

What's the best pattern y'all have come up with, in Matillion, for "flattening" a parent/child (AKA self-referencing) hierarchy? In a way that produces results like this: https://jsimonbi.wordpress.com/2011/01/16/flattening-or-naturalizing-a-parent-child-hierarchy/ http://www.daxpatterns.com/parent-child-hierarchies/ I've started...

API Variable Defaults

I am looking for a way to set defaults as part of deployments. Can this be done via the API?

slowly changing dimensions

the Type 6 Slowly Changing Dimensions example does not appear to work correctly. I was able to create a similar one that takes care of getting rid of the cartesian...

can't review "Task History" records ?

I am trying to review Task History but it is not working. "Fetching records" all the time. Please check it. Thank you

Pull data from mysql aurora and load into postgresql rds?

Is it possible to pull data from a mysql aurora instance and load that data into a postgresql rds database? We use both redshift for our data warehouse but are...

With 1.28.7, how is SQL generated and executed?

With this new version, "Matillion no longer relies on creating views in Redshift to represent components." So, what does it do instead? I can see how, within a Transformation job,...

Manifest file generator

I am trying to understand if and how we can utilize Manifest builder component to build manifest file of the objects that have been updated / created in S3 in...

question about SQS configuration

I have 2 projects under the same group. Does any way I can use different SQS in "SQS configuration" ? Looks like when I change the SQS setting, it will...

Performance, bottlenecks, Matillion instance sizes, concurrent threads

We are new to using Matillion, and we are looking for some more information about performance and instance sizes. We're quite happy with the cost of the Matillion "t2.medium" instance...

Regarding Incremental Data Loading

Hi, I'm trying to load latest sales data from a MySQL database in to a Red-Shift database. Currently I'm referring to these two articles (and videos) 1) https://www.matillion.com/videos/incremental-data-load-matillion-etl-redshift/ 2) https://redshiftsupport.matillion.com/customer/en/portal/articles/2506598-incremental-or-high-water-mark-data-loading...