Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Check and reenque microbatch if needed

Hi there, is there a process in Matillion currently to check is a microbatch queue is active and re-enqueue if that queue is not active for some reason? We've seen our queues die several times and would love for a painless way to do this safely (without overlapping queues).

1 Community Answers

Matillion Agent  

Paul Johnson —

Hi Serban,

I can think of a way to do this… in your microbatch job you would need to export the run_history_id variable which is the unique id for that particular job run, to a control table. An example of this can be found in this article

You could then create an orchestration job that reads the run_history_id from the control table and uses it in a v0 API call to check if the job is QUEUED or RUNNING.
If it is not then you can trigger the job to restart, else you can end the job. This job could be scheduled to run once an hour for example.

Regards,
Paul

Post Your Community Answer

To add an answer please login