Hi there, is there a process in Matillion currently to check is a microbatch queue is active and re-enqueue if that queue is not active for some reason? We've seen our queues die several times and would love for a painless way to do this safely (without overlapping queues).
1 Community Answers
Paul Johnson —
I can think of a way to do this… in your microbatch job you would need to export the run_history_id variable which is the unique id for that particular job run, to a control table. An example of this can be found in this article
You could then create an orchestration job that reads the run_history_id from the control table and uses it in a v0 API call to check if the job is QUEUED or RUNNING.
If it is not then you can trigger the job to restart, else you can end the job. This job could be scheduled to run once an hour for example.