Skip to content

feat(core): Adding a fake LLM with tool calling capabilities for easy integration with LangGraph #32002

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

sijil-salim
Copy link

Added a new Fake LLM in lines of FakeListChatModel to return tool calls so that it is directly compatible with LangGraph. This fake LLM can be used for testing LangGraph workflows

@sijil-salim sijil-salim requested a review from eyurtsev as a code owner July 13, 2025 10:57
Copy link

vercel bot commented Jul 13, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langchain ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 28, 2025 11:08pm

@sijil-salim
Copy link
Author

@eyurtsev Hi, I pushed a change for adding a fake llm with tool building capabilities yesterday. However, the deployment got skipped and got a message from verbal with links which upon opening shows Vercel error page. Can you please help me with what might have gone wrong and how I can rectify it

Copy link
Collaborator

@eyurtsev eyurtsev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will review a bit more carefully later, but we don't want another implementation. Instead one of the existing implementations should be enhanced properly

@mdrxy mdrxy added the core Related to the package `langchain-core` label Jul 28, 2025
@mdrxy mdrxy changed the title core: Adding a fake LLM with tool calling capabilities for easy integration with LangGraph feat(core): Adding a fake LLM with tool calling capabilities for easy integration with LangGraph Jul 28, 2025
Copy link

codspeed-hq bot commented Jul 28, 2025

CodSpeed WallTime Performance Report

Merging #32002 will not alter performance

Comparing sijil-salim:fake-llm-with-tool-calling (52ae5b0) with master (0b56c1b)

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Summary

✅ 13 untouched benchmarks

Copy link

codspeed-hq bot commented Jul 28, 2025

CodSpeed Instrumentation Performance Report

Merging #32002 will not alter performance

Comparing sijil-salim:fake-llm-with-tool-calling (52ae5b0) with master (0b56c1b)

Summary

✅ 6 untouched benchmarks
🆕 2 new benchmarks
⁉️ 6 dropped benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
🆕 test_init_time N/A 6.6 s N/A
🆕 test_init_time N/A 1.6 s N/A
⁉️ test_stream_time 1.1 s N/A N/A
⁉️ test_stream_time 519.5 ms N/A N/A
⁉️ test_stream_time 1.1 s N/A N/A
⁉️ test_init_time 1.7 s N/A N/A
⁉️ test_init_time 17.1 ms N/A N/A
⁉️ test_init_time 17.1 ms N/A N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Related to the package `langchain-core`
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants