🚀 Feature: cost metrics across all instrumentations

[nirga]

Which component is this feature for?

All Packages

🔖 Feature description

Add span attributes and metrics for total cost for each model we instrument. Right now we only send token usage but we can easily extend this and send cost as well - we just need to define a prices const in each instrumentation and multiple the prompt/completion token usage.

🎤 Why is this feature needed ?

Better visibility into the cost for OpenLLMetry usage. Right now we only provide token usage which is basically just a proxy for cost.

✌️ How do you aim to achieve this?

See feature decsription

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

• I checked and didn't find similar issue

Are you willing to submit PR?

None

[apuwk]

Is this available to work on? Im going to go ahead and give it a shot if no one else is already working on it

[kocobee]

Might be able to re-use an existing mapping: https://github.com/openlit/openlit/blob/main/assets/pricing.json