Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Database Query Component

I tried loading data from sql server to s3 bucket using Database query component , i m gettting some non -readable format data , how can i can load in csv or readable format in S3 bucket..

9 Community Answers

Matillion Agent  

Damian Chan —

Hello Sarath,

Could you send me an export of your job and a screenshot of the error, please? and just to confirm are you definitely using the Database Query component to write to S3? as this component is used for reading from a source database and writing the data in your data warehouse. It only uses S3 as a temporary staging area whilst it’s processing the data transfer.

Best Regards,
Damian


sarath I —

Hello Damian,


Thanks for your answer , i am using this S3 bucket as staging area and opting clean staged files as off ... and loading data in snowflake , i needed is there any way the data which is loading in staging S3 can be readable , if possible guide me how to ....

s3://name/.csv35def5ed-428b-47ac-bf7c-e52a29bd3080-part0 is the file which i m getting in S3 bucket.....


Matillion Agent  

Damian Chan —

Hello Sarath,

Ok, I understand now. You want them to be in human readable form. Unfortunately, there’s no option to have it in readable form but I believe the file is simply compressed without a file extension so you should be able to extract it with a tool like 7Zip and then read the file in a text editor.

Best Regards,
Damian


sarath I —

Hello Damian,

Thanks for your information
I checked with 7zip i can able to open the using excel but without headers...

One more question i have, Is there any possibility to convert the column names which is in other language before loading into Snowflake....

Thanks in Advance....


Matillion Agent  

Ian Funnell —

Hi Sarath,

Changing the column names is something you would do after loading the data – i.e. it’s a transformation task rather than a data loading task.

Best regards,
Ian


sarath I —

Hello Ian,


Thanks for your answer... i will try ...

1.I need to load all tables eg:thirty tables from a sql server database to snowflake , i tried using JDBC Incremental Load Component ... but job has run but count of rows are empty...

2.While providing password no manage available in this properties so is there any way to hide the password ...


Matillion Agent  

Damian Chan —

Hello Sarath,

1. When you click on test connection, does it connect successfully? also did you include your database in the JDBC url?

2. Sorry, I’m not completely certain on what you mean. You should be able to use the Password Manager to store your passwords safely and then use those stored passwords with your component.

Best Regards,
Damian


sarath I —

Hello Damian...

the manage password is not available in the JDBC incremental properties...


Matillion Agent  

Dan D'Orazio —

Hi Sarath,

You should be able to type in the Name of the stored password (from Project > Manage Passwords > ‘Name’ field) in the Password property of the JDBC Incremental Load Component. That is intention, but I agree, it’s not obvious as it isn’t a ‘pick list’ like it is in other areas.

Best -
Dan

Post Your Community Answer

To add an answer please login