Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Unload with header support

Will 'Unload With Header' option be supported with latest version (1.35) of Matillion for Redshift ?

https://forums.aws.amazon.com/ann.jspa?annID=6136
https://redshiftsupport.matillion.com/customer/portal/articles/2342958?b_id=8915#header0

6 Community Answers

Devang Patel —

Also as an extension to above question, will all of the spectrum transformation components (external table rewrite, external table output, copy to external table) support option to add header row since I am guessing behind the scene they are all using unload to S3 command.


Matillion Agent  

Ian Funnell —

Hi Devang,

We currently have the Text Output component for adding headers, as we have not yet added it to the S3 Unload component.

Best regards,
Ian


Devang Patel —

Very much appreciate the quick response Ian.

We looked at the text output component and seems like it has option to output with header. This would be a good option for smaller workloads. In our case we are planning to regularly unload cold data to S3 in specific spectrum structured tables for multiple tables. Ability to do above in parallel will be key as data volume grows. If we get some insight around timing of this feature, we would rather wait for a release than to develop something with text output component and rewrite the process.

Thank you,
Devang.


Matillion Agent  

David Lipowitz —

Hi Devang,

I appreciate your request for timing on this feature, but as we use an agile development methodology we cannot say with precision when this feature will be available. Improvements such as this one are often added (and sometimes dropped) at the last minute before a release.

The best we can say is that the soonest it might be included is in our next release, which is likely in 6 to 8 weeks. However, it’s quite possible that this feature would fall into a subsequent release.

Hope that makes sense and apologies for not being able to offer a more precise timeline there. Please keep an eye on our release notes, which is the best way to stay up-to-date on what features have been incorporated into which release: Matillion ETL for Redshift Release Notes

Best Regards,
Dave


Devang Patel —

Hi David,

Just wanted to follow up with you to check if this feature has been made available in the latest release 1.36 of Matillion for Redshift.


Matillion Agent  

Laura Malins —

Hi Devang

Unfortunately this request hasn’t made the current release – it is still being worked on by our development team. Unfortunately I have no news as to when it may be available.

I apologise that this isn’t the news you were hoping for.

Thanks
Laura

Post Your Community Answer

To add an answer please login