linking prompts with tracing in langchain integration

[SatheeshJM]

Describe the feature or potential improvement

The documentation under "Prompt Management" (https://langfuse.com/docs/prompts/get-started#link-with-langfuse-tracing-optional) says This is currently unavailable when using the LangChain or LlamaIndex integration.

Any plans on supporting this in the near future?

The prompt manager feature is pretty cool, but seems incomplete without a langchain integration

Additional information

No response

[marcklingen]

Currently exploring options how to make this work as prompts are then used deeply nested within a Llamaindex/Langchain trace and are not easy to detect. Do you have any ideas?

Fyi, you can use prompt management without linking traces to prompts even though being able to link is really useful.

[ajram23]

Is this why the generation count is zero when using prompts in Langchain?

[marcklingen]

yes!

[aiakubovich]

I was looking at some similar question about outputting final prompt with Langchain. There is some discussion about it: langchain-ai/langchain#912. Not sure if it helps or not with Langchain integration.

[marcklingen]

thanks for sharing!

[ajram23]

@marcklingen Curious, Will this be prioritized anytime soon?

[marcklingen]

Generally yes, but not timeline as currently a lot of effort goes into v3 infra (scaling), manual annotation workflow features, and improvements to evals. Will keep you in the loop here.