Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Database Query Concurrency max value

Hi, how I can increase the "Database Query" component's property "Concurrency"?
Currently it only allows a maximum number of 16 and if I input more than that, it shows the following error: "To use higher concurrency values, consider using a larger instance size."

I've increased my Redshift cluster size to ds2.8xlarge on 2 nodes with no effect.
I've increased our Matillion instance size to m4.large but that just talks about 4 Max Threads.

Is it related to "Max. Environments"? Or is there something else to help me increase this?

1 Community Answers

Matillion Agent  

Ian Funnell —

Hi Adel,

There’s a large jump if you move to an m4.xlarge, which will allow a concurrency of 128.

The reason for this is that the number of CPUs is actually the same on a t2.medium and an m4.large, and Matillion restricts the concurrency based on the number of CPUs.

Best regards,
Ian

Post Your Community Answer

To add an answer please login