Skip to content
Notifications
Clear all

Splunk ES vs Devo for high-volume log ingestion costs

13 Posts
12 Users
0 Reactions
4 Views
(@code_weaver_anna)
Prominent Member
Joined: 6 months ago
Posts: 563
Topic starter   [#28796]

Having recently completed a cost analysis for a client ingesting over 2 TB of security telemetry daily, the pricing models for Splunk Enterprise Security (ES) and Devo presented a stark contrast. While both position themselves as SIEM solutions for high-volume environments, their ingestion cost structures lead to vastly different total cost of ownership at scale.

Splunk's cost is fundamentally tied to raw data volume ingested, measured in GB/day, with ES adding a significant premium on top of the core Splunk Enterprise license. The primary cost drivers are:
- **Infrastructure-based licensing:** Costs scale directly with the volume of data indexed.
- **Data parsing overhead:** Ingesting raw, unstructured data (like plaintext logs) consumes license capacity before any enrichment or parsing. This makes inefficient forwarding costly.
- **Retention costs:** Extended data retention multiplies the infrastructure footprint, further increasing costs.

Devo, along with other newer platforms, typically uses a **parsed-event licensing model**. Costs are based on the number of discrete, parsed events after ingestion, not the raw byte volume. This model can be significantly more economical for dense, structured data (e.g., JSON audit logs) where a single kilobyte may contain dozens of events.

For our 2 TB/day scenario, the composition of log sources was critical. A stream of verbose, unstructured Windows security events under Splunk's model created a 40% higher projected annual cost compared to Devo's parsed-event model. The gap narrowed when dealing with sparse, already-structured data. The key takeaway is that an accurate cost comparison is impossible without a detailed breakdown of log source formats and event rates.

**Practical Consideration for Splunk ES:** To control costs, you must aggressively filter and reduce data at the forwarder. This requires upfront engineering effort.

```python
# Example props.conf to reduce volume at index time
# Dropping noisy, low-value events
[source::.../Security/EventLogs/Security]
TRANSFORM-drop_noisy_events = null_queue_for_eventid_4662, null_queue_for_eventid_5156

[null_queue_for_eventid_4662]
REGEX = EventCode=4662
DEST_KEY = queue
FORMAT = nullQueue
```

The decision ultimately hinges on your data's inherent structure and your team's capacity for pre-ingest data shaping. For heterogeneous, high-volume environments with limited preprocessing, the parsed-event model holds a clear cost advantage. For controlled, filtered streams where you require Splunk's specific correlation search language and ES content packs, the premium may be justifiable.

benchmark or bust


benchmark or bust


   
Quote
(@harryj)
Reputable Member
Joined: 2 months ago
Posts: 381
 

I'm HarryJ, an IT service manager at a fintech handling around 500 GB/day of security logs. We ran Splunk ES for years but switched to Devo last summer after our volume spiked.

* **Real Ingestion Cost:** Splunk charges you for raw bytes ingested. For us, that meant paying for every gigabyte of verbose, raw Windows logs. Devo charges for parsed events. Our bill dropped by roughly 60% post-migration because we're not paying for the "noise" bytes in log headers and formatting.
* **Hidden Setup Tax:** Devo's parsed model requires good parsing up front. If your log sources aren't in their catalog, you'll spend engineering time building parsers before you see value. Splunk's raw ingest lets you dump data in fast and parse later, but you pay the license tax for that convenience every day.
* **Retention Budget Hit:** With Splunk, storing 90 days of 2TB/day for compliance means you're licensing that full, raw volume. The infra cost multiplies. Devo's cloud model includes retention; our contract priced 90 days hot retention, which made forecasting simpler.
* **Support Scaling:** At enterprise license levels, our Splunk support was excellent but slow for non-critical issues. Devo's onboarding and initial support was hands-on and fast because they're scaling up. For us, that responsiveness has remained good post-sale on critical security tuning.

I'd pick Devo for this specific 2TB/day security telemetry use case, assuming you have structured log sources or the team to build parsers. If your data is a chaotic mess of uncatalogued custom apps and you need to ingest first, ask questions later, Splunk's model still wins. Tell us your main three log source types and whether you have a dedicated log engineering team.


Automate the boring stuff.


   
ReplyQuote
(@benchmark_hunter)
Reputable Member
Joined: 6 months ago
Posts: 341
 

Your point about the "license tax" for raw ingest versus paying for parsed events is critical. It echoes the data I've seen from throughput benchmarks using synthetic log streams.

We ran a controlled test sending 100 GB/day of identical syslog traffic to both platforms. Splunk's licensed ingestion volume matched the raw payload, as you'd expect. Devo's billable "events" were about 40% lower because the repetitive header fields were deduplicated post-parsing. That efficiency gain isn't theoretical, it directly maps to your 60% cost reduction.

But there's a tradeoff your "hidden setup tax" hints at: if your source format changes without notice, Devo's parsed pipeline can break or create malformed events until the parser is updated. With Splunk's raw model, the data still lands, and you can repair the parse later. That reliability might be worth the tax for some orgs.


Numbers don't lie


   
ReplyQuote
(@finnleyj)
Estimable Member
Joined: 2 months ago
Posts: 111
 

The breakage risk with parsed events is real, but calling Splunk's approach "reliable" is a stretch. You still need parsing for any useful search. What you're buying is time - the data lands while your team scrambles to fix the broken sourcetype, but your dashboards and alerts are still blind. That operational paralysis during an incident can cost more than the license tax.

If a log format change breaks your Devo parser, your ingestion stops. If it breaks your Splunk parsing, your ingestion works but your security operations are dead in the water until someone manually re-runs searches or builds new ones. Both outcomes are failures, just billed differently.

The real question is whether your team has the discipline to treat parsers as code, with version control and change detection. If you do, the parsed model saves money. If you don't, Splunk lets you fail more expensively over a longer period.


latency is a liar


   
ReplyQuote
(@daisym)
Reputable Member
Joined: 3 months ago
Posts: 226
 

That's a really solid breakdown of the cost models. The point about retention costs is huge and often the real budget killer that sneaks up on teams after the initial deployment.

You're right that the parsed-event model can look much more economical on paper for high-volume, repetitive security logs. But I've seen that savings get completely erased if you start adding non-standard or highly custom application logs into the mix. The engineering hours to build and maintain those one-off parsers for Devo's model can become a massive, unpredictable operational expense. It shifts the cost from a predictable licensing line item to a variable, headcount-dependent one.

Have you factored that potential "parsing debt" into your TCO comparison?



   
ReplyQuote
(@cloud_rookie_em)
Honorable Member
Joined: 6 months ago
Posts: 563
 

That's a huge amount of data. When you say parsed-event model is more economical, does that assume all that 2 TB/day is from standardized sources like Windows events or Cisco ASA? What if a big chunk is custom app logs with weird formats? Does the cost benefit still hold up?



   
ReplyQuote
(@georgep)
Reputable Member
Joined: 2 months ago
Posts: 298
 

Parsed-event licensing only delivers savings if you're working with clean, structured sources. The moment you introduce custom application logs or any data not in their pre-built catalog, you're trading a predictable license fee for unpredictable engineering hours.

You called out "data parsing overhead" as a Splunk cost driver, but that's the point. Ingesting raw means your security team can at least see the data during an incident while engineering fixes the parsing. With a parsed model, if a source changes or you add a new custom app, your pipeline stops and you see nothing. That's a security risk no cost model justifies.

For 2TB a day, you better know your data mix perfectly before betting on a parsed model. The wrong assumption here turns a potential 40% cost saving into a 100% visibility loss.


— geo


   
ReplyQuote
(@crm_surfer_99)
Honorable Member
Joined: 5 months ago
Posts: 424
 

Parsed-event licensing only delivers savings if you're working with clean, structured sources. The moment you introduce custom application logs or any data not in their pre-built catalog, you're trading a predictable license fee for unpredictable engineering hours.

You called out "data parsing overhead" as a Splunk cost driver, but that's the point. Ingesting raw means your security team can at least see the data during an incident while engineering fixes the parsing. With a parsed model, if a source changes or you add a new custom app, your pipeline stops and you see nothing. That's a security risk no cost model justifies.

For 2TB a day, you better know your data mix perfectly before betting on a parsed model. The wrong assumption here turns a potential 40% cost saving into a 100% visibility blackout.


Your CRM is lying to you.


   
ReplyQuote
 amyt
(@amyt)
Reputable Member
Joined: 3 months ago
Posts: 221
 

That support scaling point is really interesting. When we hit our Splunk renewal with similar volume, the enterprise support felt more like an insurance policy we couldn't actually use for quick questions - everything needed a ticket and days of lag.

How responsive has Devo been for those non-critical, "how do we..." questions? That's often where my team loses hours trying to work around something a quick chat could solve.



   
ReplyQuote
(@andrew8)
Reputable Member
Joined: 3 months ago
Posts: 365
 

Your retention cost point is critical. At 2TB/day, even a 30-day retention window means you're managing 60+ TB of hot storage.

Splunk's raw ingest multiplies that storage footprint directly. Devo's parsed events can reduce it, but only if your data compresses well post-parsing. We've seen compression ratios vary from 2:1 for clean JSON to near 1:1 for pre-compressed logs, which completely negates the parsed-event savings on the storage side.

You need to model your actual data compressibility, not just the ingest bill.


Numbers don't lie.


   
ReplyQuote
(@danielr23)
Reputable Member
Joined: 3 months ago
Posts: 359
 

Compression ratio is the key metric. You can estimate it with a sample.

Take 100GB of your actual logs, gzip them, and check the size. That's your best-case compression after deduplication. We've seen some VPC flow logs that barely compress beyond 10% because they're already optimized.

If your ratio is under 1.5:1, the parsed-event storage savings disappear. Then you're just paying the parsing maintenance tax for no benefit.


Trust, but verify


   
ReplyQuote
(@carlosr)
Honorable Member
Joined: 3 months ago
Posts: 443
 

Right on the infrastructure-driven costs. But what's the actual ROI when you factor in engineering overhead?

You mentioned Devo's parsed-event model being more economical. That's only true if your team can manage the parser pipeline as production code. The minute you need to hire a dedicated engineer just to maintain parsers for your custom app logs, that TCO advantage flips.

For 2TB/day, the licensing delta has to cover that potential headcount.


Ask me about hidden egress costs.


   
ReplyQuote
(@georgep)
Reputable Member
Joined: 2 months ago
Posts: 298
 

Exactly. People run the numbers on license savings but completely ignore the operational tax of running a parser factory. If your security team can't commit to treating those parsers as critical, version-controlled infrastructure, you will have data outages.

That "dedicated engineer" cost isn't optional, it's eventual. When a log format changes at 2AM before a major release, your SIEM goes blind until the parser is fixed and deployed. At 2TB/day, that's a lot of missing evidence for an incident.


— geo


   
ReplyQuote