Every hot path, deliberately chosen
fast-langraph doesn’t rewrite LangGraph. It swaps out the handful of well-isolated hot paths that dominate production cost — checkpoint serialization, executor churn, state merging, and redundant LLM calls — with Rust implementations, and leaves everything else vanilla.
The single biggest source of production LangGraph latency — moved to Rust.
RustSQLiteCheckpointer
up to 737×RustSQLiteCheckpointer A drop-in replacement for LangGraph’s SQLite checkpointer. It moves the hot serialization path into Rust, running up to 737× faster than Python deepcopy on large state and 5–6× faster end-to-end.
Learn more →Fast state merging
45.9×langgraph_state_update Rust-backed state merging for high-frequency inner-loop updates — about 1.4 µs/call, and 45.9× faster than the Python path on tight 1,000-step workloads.
Learn more →Cut the per-invocation overhead that Python adds before your graph even runs.
Automatic shim mode
2.3× invoke pathshim.patch_langgraph() One import transparently patches LangGraph at load time. No graph code changes. Caches ThreadPoolExecutors across invocations, removing the largest single per-invocation cost.
Learn more →Manual acceleration
opt-infrom fast_langgraph import ... Skip the monkey-patch and wire in individual Rust components exactly where you want them. Full control, same speedups, explicit call sites.
Learn more →Graphs re-issue identical prompts through retries, branches, and tool routing. Stop paying twice.
Response caching
9.78×@cached A one-line decorator around your LLM call site. Content-addressed by arguments, sub-microsecond lookup, configurable LRU eviction. 9.78× throughput at a 90% hit rate — and a direct cut to API spend.
Learn more →Function caching
1.6×@cached (compute) The same cache works for expensive deterministic computations inside nodes — embeddings, parsing, scoring — for a ~1.6× speedup on repeated calls.
Learn more →You can’t fix what you can’t see. Find the real bottleneck first.
GraphProfiler
low-overheadGraphProfiler A low-overhead profiler that attributes wall-clock time across checkpointing, state updates, node execution, and LLM calls — so you accelerate the path that actually matters.
Learn more →Upstream-tested compatibility
0 failures85 / 88 tests fast-langraph runs LangGraph’s own upstream test suite against its shimmed implementation — 85 pass, 0 fail, 3 skipped for environment reasons — against LangGraph 1.0.4.
Learn more →Hit a LangGraph scaling wall?
We help production teams squeeze every bottleneck out of LangGraph — checkpoints, state, LLM costs, memory. Honest audits. Measurable fixes.