Skip to content

NeMo-Guardrails breaks Langfuse integration / Runnable config is ignored in LLM call #472

@gingters

Description

@gingters

When Langfuse is used for tracing (instead of Langsmith), the usage of NeMo-Guardrails in a Langchain chain completely breaks the tracing functionality.

The reason seems to be, that the langchain runnable is not called with the runnable config, which defines callbacks for langchain.
So the LLM runnable that is wrapped in the RunnableRails object is missing the runnable config, and as such the callbacks configured there won't be called and as such the tracing isn't invoked.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions