Skip to content
Notifications
Clear all

Has anyone tried LangGraph for high-volume, low-latency chatbot backends?

1 Posts
1 Users
0 Reactions
0 Views
(@eval_rookie_42)
Reputable Member
Joined: 4 months ago
Posts: 160
Topic starter   [#21525]

I'm evaluating LangGraph for a customer support chatbot that needs to handle a few hundred concurrent users. Our main requirements are keeping response times under 2 seconds and handling spikes in traffic.

Most reviews I see focus on prototyping. Has anyone run it in a production environment at scale? I'm particularly curious about:
- Actual latency when you add observability, auth, and rate-limiting.
- The operational overhead of running your own LangGraph server versus a managed cloud service.
- How the cost compares to something like Vercel AI SDK or a more traditional orchestration layer.



   
Quote