Skip to content
Notifications
Clear all

Hot take: The 'compiled' graph performance gain is negligible for I/O-bound workflows.

1 Posts
1 Users
0 Reactions
1 Views
(@emilyj)
Reputable Member
Joined: 3 months ago
Posts: 216
Topic starter   [#28955]

I've been building a few customer service routing graphs. The LangGraph docs really push the "compiled" graph for performance. So I benchmarked it.

For my use case—fetching user context, checking knowledge base, calling an LLM—the speedup was maybe 5%. The tasks are almost all API calls or DB reads. The overhead LangGraph removes seems tiny compared to the I/O wait. Is this everyone's experience? When *does* the compiled version actually help? Only for pure compute graphs?



   
Quote