Advanced

S3 Object Prefix (File extension issue)

I have a staging table - Account and I am trying to load a text file (Delimited by Pipe) from S3. This is a text file (.TXT) But I do...

Filechecker and update status flag

Hello, I am loading a file into a table (single column) - which has several file names. - This is a S3 load Now in the second step - I...

Component not in a valid sate error

Hi ! I have one transformation job. Table Input and Table Output (Truncate load) Table Input - (Target Table name) - I have defined a variable Var1 and schema is...

Python Script - Syntax to define Variable

Hi, I have a python script and a Table iterator. Can you please validate if the way variable is defined is correct ? cursor = context.cursor() cursor.execute('select count(*) from md_staging.${stage_table}')...

Auto scaling Matillion instance

We have uneven NRT workload throughout the day which may pick up in the afternoon and slows down after 6:00 PM. During pick hours, we are seeing some of the...

Manifest strategy

Hi, As an example - I have an account table and I have to use a Manifest strategy to load data. Assume Manifest file has one entry today wrt Account....

API Generator Properties

The last input box on the API generator form is labeled Properties. How do I translate my authorization header into the correct syntax? <rsb:set attr="Header:Name#" value="Authorization" /> <rsb:set attr="Header:Value#" value=...

java

where are the java logs

Job scheduling order

Hi, I have created one master matillion job that references various matillion jobs to load the data into redshift. Start---> (1)Matillion Orch Job that creates 10 stage tables and S3...

Load strategy

Hi ! I have two schemas - stage and target. I have two table. Test_Stage and Test_Target. Columns - (Yearmonth,Code,Revenue) Here is Test_target table data. 201702 10 500 201703 20...