In BonsaiProver, reduce latency from workflow completion to returning the result

[nategraf]

Feature

Reduce the latency overhead of polling Bonsai for workflow status

Motivation

Currently, the BonsaiProver implements polling with a 5 sec interval to check the status of the workflow. Especially as our proving times improve, and small proofs can complete in less than 5 seconds of proving time, this adds latency to the user experience.

risc0/risc0/zkvm/src/host/client/prove/bonsai.rs

Line 87 in 9a90de9

std::thread::sleep(Duration::from_secs(5));

Implementation

We likely do not want to simply increase the polling frequency, as that will add a wasteful increase in load the API servers. Implementing long polling, or web sockets would allow us to improve upon this without additional load.

[linear]

ZKVM-420 In BonsaiProver, reduce latency from workflow completion to returning the result