Replies: 1 comment 2 replies
-
Hi @PrimosK we are working on this right now, could you please take a look and provide a feedback? Here is a very early draft: #1058 |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone,
I have a requirement to log each prompt (sequence of messages) and completion (response) including statistics (prompt tokens, total tokens, completion tokens) into a dedicated log/textual file in a custom format.
Now this can be easily achieved using
ChatLanguageModel
API:... as I can log all necessary information by wrapping this call and extracting data from
Response
,AiMessage
, andList<ChatMessage>
.Is there any way to do the same when using AI Services API.
I understand that I can use structured output like
Response<AiMessage>
which would give me the message and statistics... But still - I would not have infomration of what text (messages) was actually passed to the model.Beta Was this translation helpful? Give feedback.
All reactions