Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Microsoft OneDrive via Matillion S3 Put Object

Can Matillion pull data from Microsoft OneDrive? I've setup an S3 Put Object using the following settings and it's not connecting, assuming it's due to the requirement for login credentials?

Input Data Type: HTTPS
Perform Certificate Validation: Yes
Input Data URL: https://(Direct link to data file)
Username: (OneDrive Username)
Password: (OneDrive Password)
s3 Path: (S3 Directory) <--verified this path is accurate elsewhere in my job.
Encryption: None

I believe the problem here is associated with the Input Data URL line, hoping someone has successfully pulled data from OneDrive using Matillion and can verify the syntax for a correctly mapped OneDrive URL.

2 Community Answers

Matillion Agent  

Laura Malins —

Hi Patrick

First of all apologies for not coming back to you on this earlier. I have it down as a ToDo on my list.

I have successfully connected to a file on OneDrive. I got the link of the file on OneDrive from under the share option and used this link in the Input Data URL. My link looked like this:

https://1drv.ms/u/s!Au9LfscLp_0F1UyZhV-cL8IewqFa

However I didn’t have to grant any permissions on the file.

If I make the file public then I can access it without a username and password. If it’s not public I need to put my username as xxxx.xxx@outlook.com and my onedrive password in.

What happens when you try the above? Do you get an error message?

Thanks
Laura


Matillion Agent  

Laura Malins —

Hi Patrick

As discussed, your best option for your file is to use the wget command in a bash script component to download the file locally and then copy to s3:

wget -O /tmp/myfile.csv https://company.sharepoint.com/myfilepath?download=1

s3 cp /tmp/myfile.csv s3://my-bucket/myfile.csv

Thanks
Laura

Post Your Community Answer

To add an answer please login