support ollama generate reponose when code completions.

[linpan]

What happened?

curl http://localhost:11434/api/generate -d '{
"model": "llama2",
"prompt": "Why is the sky blue?"
}'
Response
A stream of JSON objects is returned:

{
"model": "llama2",
"created_at": "2023-08-04T08:52:19.385406455-07:00",
"response": "The",
"done": false
}

error:

Relevant log output or stack trace

No response

Steps to reproduce

No response

CodeGPT version

2.4.0

Operating System

None

[PhilKes]

#510 will introduce Ollama as a high-level service and use its native API to support code-completions

[boswelja]

To add to that, specifying api/generate doesn't work because the request and response formats don't match OpenAI services. Currently, using OpenAI-compatible APIs is a requirement