Feature/gptscript runner

[rusenask]

Adding a dedicated script runner, currently only in the docker-compose.dev.yaml:

  gptscript_runner:    
    build:
      context: .
      dockerfile: Dockerfile.gptscript        
    restart: always
    environment:
      - OPENAI_API_KEY=${OPENAI_API_KEY:-}
      - API_HOST=http://api:80
      - API_TOKEN=${RUNNER_TOKEN-oh-hallo-insecure-token}
      - CONCURRENCY=20 # number of tasks to run concurrently
      - MAX_TASKS=1  # max number of tasks to run before exiting. Set to 0 to run forever

Goals:

• Concurrency
• Max tasks before restart
• Decent throughput so it would be possible to have an APIs that use gptscript under the hood

Next steps

While a one-shot runner works for low req/s callers, multiple runners should be used. There will be some additional work done on the pubsub package to prevent message from being sent to the runner that's about to shutdown so we don't have to retry.