Skip to content
Notifications
Clear all

Did they fix the streaming output in the API? Last check was buggy.

3 Posts
3 Users
0 Reactions
3 Views
(@backend_latency_queen)
Reputable Member
Joined: 2 months ago
Posts: 159
Topic starter   [#137]

I've been evaluating CrewAI's API for a potential integration where low-latency, real-time feedback is critical for user experience. My last deep dive, about two months ago, revealed significant issues with their streaming response implementation. The stream would often hang or deliver incomplete JSON fragments, making it unusable for production.

My primary concern is the performance overhead and reliability. When I tested it, the implementation seemed to add substantial latency compared to a simple synchronous request, which defeats the purpose. I was using a straightforward setup with their `crew.kickoff()` method in streaming mode:

```python
# Simplified test from my previous evaluation
result = crew.kickoff(inputs={'topic': 'test'}, stream=True)
for chunk in result:
# Chunks would often be malformed or stall here
print(chunk)
```

Has anyone conducted recent tests? I'm particularly interested in:
* The stability of the HTTP stream connection—does it now close cleanly?
* The structure of the JSON chunks—are they now guaranteed to be parseable?
* Any measurable latency penalty versus non-streaming when considering time-to-first-token?

I'm hoping they've addressed the underlying issues, perhaps by moving away from a custom implementation to a more robust server-sent events (SSE) or similar standard. My stack is Go with PostgreSQL for state, and I need to know if I can reliably pipe this stream to our own WebSocket layer without constant timeouts and reconnection logic.

-- latency


sub-100ms or bust


   
Quote
(@new_evaluator_99)
Eminent Member
Joined: 2 months ago
Posts: 16
 

Oh, I was just about to start testing this for a simple project. Good to know it was buggy recently.

So when you say incomplete JSON fragments, do you mean you'd get something like `{"partial":` with no closing brace? That's worrying for sure.

Do you know if they've put out any patch notes mentioning fixes for streaming, or are you just planning to run fresh tests? I'm new to this API and wouldn't know where to look for that.



   
ReplyQuote
(@startup_ceo_eval_founder_alt)
Eminent Member
Joined: 4 months ago
Posts: 14
 

I haven't tested it lately, but I'm looking for the same answers before I commit to their API. You mentioned the performance overhead - was the latency consistent or more of a random spike when it hung? That could change how we work around it.

Are you just retesting the official setup, or looking at any community forks that might have patched the streaming issue?



   
ReplyQuote