Advanced

Job scheduling order

Hi, I have created one master matillion job that references various matillion jobs to load the data into redshift. Start---> (1)Matillion Orch Job that creates 10 stage tables and S3...

Load strategy

Hi ! I have two schemas - stage and target. I have two table. Test_Stage and Test_Target. Columns - (Yearmonth,Code,Revenue) Here is Test_target table data. 201702 10 500 201703 20...

Job Status Messages

Hello ! We have Matillion jobs designed in a sequential manner as shown below. 1) create stage dim tables and load them from S3 bucket 2) create target dim tables...

Nodata Input object and load time

Hi ! There are two scenarios. 1) In orchestration job, you have an input file- Product.txt which is totally empty. It has no data. No column names either. I have...

Iteration in API Profile's RSD Language

Hi all, Reading through the CData's RSD:scripting docs: http://cdn.cdata.com/help/DWA/jdbc/pg_items.htm, it seems to be a very powerful way to interact with various API to extract data. Is there any documentation how...

Checks before Truncate and Load

Hi, I have an empty data file ACCOUNT.txt. I have a Matillion job that creates ACCOUNT_STAGE table and then loads the ACCOUNT.txt from S3 bucket. Job - 1 I found...

Preparing a file for S3 load

Hi ! We have a Table called ACCOUNT. We generally receive a file in this format = ACCOUNT_UIP_20180201_161512.TXT What we do is - We first manually rename a file like...

Branching and merging with code repositories

Hi What is your recommendation regarding branching and merging with code repositories (e.g. GIT) when you have a team of developers working with Matillion? For example, you have a Master...

Import json in Matillion using API

Hi, I am trying to import a json in matillion to a specific project and group. I am using the following curl command :- curl -X -u ec2-user:i-069fad7255685211f POST http://54.40.185.68:8080/rest/v0/projects?groupName=ghhusdw&projectName=test_ora...

API Call with encryption

Has anyone tried encrypting the client credentials when making an API call from Matillion to an external data provider?