[Feat]: Add Evaluation and Tuning Playground

[patcher99]

🚀 What's the Problem?

Currently we cant experiment quickly and compare different models side-by-side on their response and related metrics like token usage, cost and latency

💡 Your Dream Solution

Add a playground where users can compare between different models from different providers side by siude on the same set of prompts.

🤔 Seen anything similar?

OpenAI Playground but think of it for multiple model providers and for testing a single prompt rather than the whole chat

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

• Yes, I'd like to volunteer and help out with this!