Skip to content
Comparing the cost ...
 
Notifications
Clear all

Comparing the cost of false positives between Akamai and Imperva for our stack.

3 Posts
3 Users
0 Reactions
4 Views
(@migration_warrior_2024)
Trusted Member
Joined: 4 months ago
Posts: 30
Topic starter   [#1965]

Alright, I'm deep into a migration evaluation that's a bit outside my usual CRM/data territory, but the core challenge is familiar: quantifying the hidden costs of a security platform switch. We're currently on Akamai (Kona Site Defender + Prolexic) and have a compelling quote from Imperva (Cloud WAF + DDoS) that looks great on a per-request/license basis.

But as we all know, the sticker price is just the entry fee. My real headache, and why I'm here, is modeling the **operational cost of false positives** between these two. A blocked legitimate user or a choked API call has a cascading effect: support tickets, dev ops time for tuning, lost revenue, and eroded trust.

I've started building a internal "cost calculator" and I'm curious how others have approached this, specifically for these two vendors in a stack like ours: modern API-first app (Kubernetes on GCP) with a legacy monolith still handling checkout.

Here’s my framework so far. The variables are huge, but I'm trying to pin down typical deltas:

* **Baseline Configuration & Learning Period:** Both systems need tuning. Imperva's "Incident Logic" vs. Akamai's "Kona Rule Sets." How long, typically, did it take you to reach a "steady state" of low false positives after initial deployment or a major change? We're assuming a dedicated 0.5 FTE security engineer for tuning.
* **Akamai:** Our current baseline. The first 90 days were rough. We had to heavily customize rules for our API payloads (lots of nested JSON). The time spent was mostly in their Security Config Manager, building exceptions.
* **Imperva (from our PoC):** The auto-learning policy setup was faster to get running, but we saw more "weird" blocks initially on the legacy monolith's form submissions. The tuning interface feels different—more traffic pattern focused vs. direct rule editing.

* **Cost Centers I'm Trying to Quantify:**
1. **Engineering Time:** Minutes/hours per week spent reviewing blocks, adding exceptions, testing in staging. This is the big one.
2. **Support Overhead:** Volume of "I can't check out" or "API is down" tickets routed to app support that trace back to WAF.
3. **Business Logic False Positives:** This is my nightmare scenario. The WAF blocking something because it looks like an attack but is actually valid business traffic (e.g., a weird but legitimate search query, a specific product code in a parameter). How granular are the tools to *safely* allow these without opening a hole?

* **A snippet from our logging aggregation to illustrate the type of event we're assessing:** This isn't about the raw block count, but the investigation burden per event.

```json
{
"security_event": {
"vendor": "akamai",
"rule_id": "3000010",
"sig_name": "SQL Injection Probing",
"url": "/api/v1/orders",
"client_ip": "10.0.1.100", // This is actually our own backend service!
"blocked": true,
"request_body": "product_code=SELECTION-2024&promo=SAVE20"
}
}
```
In this case, `product_code` containing "SELECT" triggered it. Tuning meant creating a very specific URL+parameter exception.

**My core question for those who've lived through a migration or run A/B tests:** Did you find a measurable, sustained difference in the **"friction" or "noise" level**—and thus the ongoing operational cost—between Akamai and Imperva once tuned? Was one platform notably more adaptive or precise for certain traffic types (e.g., APIs vs. traditional web forms)?

I'm especially keen to hear about rollback strategies you had in place during the evaluation. We're considering a parallel run with traffic shadowing, but the false positive problem only shows up with real blocking.


Backup twice, migrate once.


   
Quote
(@startup_ceo_evan)
Active Member
Joined: 4 months ago
Posts: 11
 

I focused heavily on tuning time in my last eval. For our API endpoints, Imperva's default incident logic took about 2 weeks of aggressive whitelisting to stop choking our webhooks. Akamai felt more predictable from the start, maybe because we were already in their ecosystem. The hidden time sink was training their ML models on our legacy checkout flow.

Don't forget to cost in the ongoing maintenance. Once past the initial learning, which platform needs more hands-on tweaks? For us, that's where the real operational difference showed up.

What's your assumed hourly rate for devops/support labor in your model? That variable blew my numbers wide open.



   
ReplyQuote
(@revops_calculator)
Active Member
Joined: 2 months ago
Posts: 13
 

Your question about the hourly rate is precisely where most models fail. People plug in a generic $80/hr IT salary, but that ignores the true cost structure. You need to model for two distinct phases and roles.

The initial tuning, like your two-week whitelisting sprint, consumes senior devops time at a fully-loaded cost, often $150-$200/hr. However, the ongoing maintenance you mentioned is usually handled by a tier-2 cloud operations analyst. That rate is lower, but if the platform requires frequent adjustments, the aggregate cost over three years dominates. I built a Monte Carlo simulation for a similar switch last quarter, varying the assumed tuning duration and maintenance frequency. The outcome was highly sensitive to the maintenance variable; a platform requiring 4 hours a month of tweaks versus 2 hours a quarter created a larger TCO gap than the initial tuning labor.


RevOpsMetric


   
ReplyQuote