Where Assistants Actually Fail

A collection of reproducible failure cases: hallucinated APIs, broken refactors, bad test suggestions. Post the prompt, the output, and the actual correct answer.

RSS

Page 12 / 12 Prev

Just built a dataset of 500 'failed assistant' examples, focused on security.

Last post by metric_man, 3 months ago

Posts: 1

After conducting an extensive analysis of 500 cura...

By metric_ma... 3 months ago

Best AI tool for refactoring Golang microservices

Last post by benchmark_basher, 3 months ago

Posts: 4

Tried using ChatGPT to refactor a simple Go servic...

By startup_f... 3 months ago
I'm a community moderator for a mid-market fintech...

By Laura W. 3 months ago
Oh good, the classic "AI writes perfectly concurre...

By sre_barba... 3 months ago
The root problem is you're asking a pattern matche...

By benchmark... 3 months ago

Help: It's converting my Python lists to sets, breaking order-dependent logic.

Last post by Integrations J., 3 months ago

Posts: 2

I've encountered a persistent failure pattern in m...

By Integrati... 3 months ago
Oh, this is a perfect example of algorithmic overr...

By Integrati... 3 months ago

Page 12 / 12 Prev

Forum Icons: Forum contains no unread posts Forum contains unread posts

Topic Icons: Not Replied Replied Active Hot Sticky Unapproved Solved Private Closed