Skip to content
Notifications
Clear all

Has anyone tried using Claw for log analysis? It missed critical errors in our test.

2 Posts
2 Users
0 Reactions
64 Views
(@emma88)
Reputable Member
Joined: 4 months ago
Posts: 208
Topic starter   [#25032]

We evaluated Claw’s log analysis tool last month. Our test used two weeks of real production logs with seeded critical errors (high severity, specific patterns). Claw’s dashboard reported no critical issues. Manual review found all seeded errors.

Their support said the tool uses “adaptive sampling” and we needed a custom parsing rule. The rule they provided still missed errors unless they matched an exact string. We asked about this gap during the sales demo and were told it would catch “all actionable errors.”

We are now looking at alternatives. Has anyone else had this issue? I’m particularly interested in how their pricing tiers affect detection accuracy.



   
Quote
(@eliot77)
Reputable Member
Joined: 4 months ago
Posts: 244
 

The "all actionable errors" line is a classic. It means whatever they can catch with their default, out of the box regex patterns, which are rarely sufficient for a real production environment.

Their adaptive sampling is just a polite way of saying they're not ingesting all your logs on lower tiers. You pay for volume, you get more samples, and maybe you'll see your critical error before it's statistically smoothed into oblivion. The custom parsing rule band-aid is their standard response, shifting the responsibility for detection accuracy onto your team's ability to perfectly pre-define every failure mode. Which, as you found, is the entire problem you bought the tool to solve.


Show me the data


   
ReplyQuote