Problem
When running prompts on multiple VMs via the orchestrator, we currently have to poll for completion status. This is inefficient and makes it hard to know when agents have finished their work.
Proposed Solution
Add a notification mechanism so that we can be notified when agents complete their tasks:
- SSE events - The
/events/vms endpoint could emit task_completed events when a VM finishes processing
- Webhook support - Option to configure a webhook URL that gets called on completion
- CLI notification -
vers-client.sh vm-wait-any that blocks until any VM completes
Current Workaround
We have to poll session/outputs or check metrics.queueLength repeatedly to detect completion.
Related
This came up while orchestrating 5 VMs to work on PRs in parallel - we had to keep checking status manually.
Problem
When running prompts on multiple VMs via the orchestrator, we currently have to poll for completion status. This is inefficient and makes it hard to know when agents have finished their work.
Proposed Solution
Add a notification mechanism so that we can be notified when agents complete their tasks:
/events/vmsendpoint could emittask_completedevents when a VM finishes processingvers-client.sh vm-wait-anythat blocks until any VM completesCurrent Workaround
We have to poll
session/outputsor checkmetrics.queueLengthrepeatedly to detect completion.Related
This came up while orchestrating 5 VMs to work on PRs in parallel - we had to keep checking status manually.