-
Notifications
You must be signed in to change notification settings - Fork 107
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🚀 Feature: log content filter results in proper attributes (Azure OpenAI) #855
Comments
Interested |
According to the Azure official documentation https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cpython-new
I believe you need to check whether the finish_reason is 'stop' or 'content_filter', rather than checking if the content_filter_results is null. |
@sukidesuka thanks for flagging! I was lazy and didn't test it properly for Azure. I've now added proper testing specifically for Azure and fixed the issue so this won't happen. See #886 |
I can help! |
Sounds good @lauradowell! |
Which component is this feature for?
OpenAI Instrumentation
🔖 Feature description
Azure OpenAI has an option to filter inappropriate content, which returns a slightly different response. While #854 handles this partially, we should explicitly log all the reasons in separate attributes.
🎤 Why is this feature needed ?
✌️ How do you aim to achieve this?
Create one or more attributes to log the reasons content was redacted.
🔄️ Additional Information
No response
👀 Have you spent some time to check if this feature request has been raised before?
Are you willing to submit PR?
None
The text was updated successfully, but these errors were encountered: