Orchestration Components

Question for json layout setting of S3 load component

I have a json file in S3 and I want to load it to redshift. Below is my json file. { "customer_id":452435, "products":[ { "item_id":222, "item_type":"Qcommerce::Pack", "price":78, "quantity":1 }, {...

How to create csv file with double double quote texts ?

Hi, How to setup Text output (or other component) to create CSV file with double quote all texts ? Can I set Output type to something like CSV quote as...

Escaping Iteration / Handling large result sets from API Queries

I am looking to set up an API query which pages the results without knowing how many total pages there will be. Does anyone have an example of an orchestration...

S3 put object unpack tar-gz

Hi, Can the S3 put object unpack tar.gz files? This is the format we receive files from our sftp today.

Save result from Database Query Component in S3

Hi. Is it possible to use the query component to save the result in s3? Since it already stages the data this should be no big deal to do. Regards...

Replace Table won't drop existing table

I run the Create/Replace Table component with option Replace. After that, when I read a sample from the table with Table Input, I get row count 0 and the sample...

Jira connector

Has anyone successfully extracted data from a Jira server into Redshift using Matillion? Thanks, Ed

python boto script connect to S3 Bucket fails

Hi I'm following the simple example from your support page on using boto in a python script to get to our s3 bucket. https://redshiftsupport.matillion.com/customer/portal/articles/2234735-python-script here's the snippet i created: import...

Excel Query Component has limited S3 options

I'm trying to use the Excel Query orchestration component but getting errors from S3 in that I cannot write to the bucket. This could be due to the fact that...

Creating folders in S3

Is there a method for creating new folders in existing S3 buckets from within a matillion orchestration component?