Playground Area in Prompt Management #1170
Replies: 6 comments 3 replies
-
Agree, ideally we aim for a playground which can replay values inserted within prompt templates to backtest a new prompt iteration quickly on production data. No timeline on this yet but I am very excited about it |
Beta Was this translation helpful? Give feedback.
-
Great new feature! Very useful to test new prompts for different models very quickly. Maybe an improvement for the future could be to add the possibility to mock tools by API or manually supplying data so a prompt for a RAG / Agent flow can be tested/experimented with. |
Beta Was this translation helpful? Give feedback.
-
released today during launch week as @Stormyy already realized: https://langfuse.com/changelog/2024-04-23-prompt-playground |
Beta Was this translation helpful? Give feedback.
-
Hi @marcklingen, this is amazing to see! Are there plans to support using our own models. Like those we have on AzureOpenAI or AWS bedrock. Asking for privacy reasons as we self host langfuse. |
Beta Was this translation helpful? Give feedback.
-
Hello, I am using a locally deployed service. May I ask if Playground's capabilities will be open-source? I have noticed that you have placed Playground in the/web/src/ee directory. Are you planning to charge for it? If there is no plan, when will it be released to the open source version |
Beta Was this translation helpful? Give feedback.
-
Adding Playground feature to Self-hosted version would be awesome. I hope we get the open source version of it soon |
Beta Was this translation helpful? Give feedback.
-
Describe the feature or potential improvement
I would like the ability to test out prompts within langfuse itself instead of having to switch back and forth between my IDE and langfuse when finalizing a prompt. When adding a prompt to prompt management I should be able to connect to my model and have some control over output like max tokens and temperature. This way I am able to iterate much more quickly and stay within langfuse when creating prompts.
Additional information
No response
Beta Was this translation helpful? Give feedback.
All reactions