Better ollama load balancing

[asedmammad]

Pull Request Checklist

• Description: Briefly describe the changes in this pull request.
• Changelog: Ensure a changelog entry following the format of Keep a Changelog is added at the bottom of the PR description.
• Documentation: Have you updated relevant documentation?
• Dependencies: Are there any new dependencies? Have you updated the dependency versions in the documentation?

---

Description

This introduces a load balancer scheme in ollama app of the backend, resolving issue #1081. The implementation allows setting different strategies in the .env file, with support for RoundRobin and WeightedRoundRobin currently available.

---

Changelog Entry

Added

• Implemented load balancer scheme for ollama backend

• Added RoundRobin and WeightedRoundRobin strategies

• Configured strategies in .env.example file for easy customization

[asedmammad]

I can work on adding the ability to change the strategy, weight values and other parameters directly through the UI. This would allow users to easily configure the load balancer settings without needing to modify the .env file.