Is beam search ready?

[Sunt-ing]

I see efforts to implement beam search in llama.cpp and find relevant code, but I cannot find documents about how to set the relevant parameters (e.g., num_beams). Is this feature ready?

[ggerganov]

There was an initial implementation (still exposed via llama.h), but IMO it has to be reimplemented from scratch as a standalone example