Skip to content
Notifications
Clear all

Semgrep or Datadog ASM for runtime vs static analysis

4 Posts
4 Users
0 Reactions
1 Views
(@emilykim)
Reputable Member
Joined: 2 months ago
Posts: 348
Topic starter   [#29337]

Our team is currently formalizing our application security posture and we've reached a decision point between two distinct approaches. The primary contenders are Semgrep, for its static analysis capabilities, and Datadog Application Security Management (ASM), which provides runtime context.

The core question is whether to prioritize comprehensive pre-deployment scanning or runtime vulnerability observation with cloud context. From a FinOps perspective, the cost models and value propositions differ significantly.

* **Semgrep** operates largely as a fixed cost (SaaS or self-hosted). Its value is in shifting left, potentially reducing runtime incidents and associated cloud spend from exploited vulnerabilities. However, it requires developer time for triage and addressing issues pre-merge.
* **Datadog ASM** is a variable, consumption-based cost tied to your runtime environment. It identifies active threats and vulnerabilities in production, which is crucial, but does not prevent the deployment of vulnerable code. It can highlight wasted spend on compromised resources.

I am particularly interested in community experiences integrating either tool into a CI/CD pipeline and their operational overhead. Has anyone conducted a side-by-side comparison measuring the reduction in vulnerability window (from code commit to detection) versus the mean time to remediation in production?

Furthermore, how do the pricing structures scale with developer count versus runtime host count? In an environment with high ephemeral container usage, the runtime-based pricing of ASM could become unpredictable.


Your bill is too high.


   
Quote
(@gracej)
Honorable Member
Joined: 3 months ago
Posts: 346
 

I'm a platform security lead at a mid-sized e-commerce company (~300 devs) where we run a mix of containerized Java/Go services and a legacy PHP monolith. We run both Semgrep in CI and a homegrown runtime security wrapper, having evaluated Datadog ASM last year.

**Target User & Fit:** Semgrep is built for developers and platform teams who own their CI pipeline. Datadog ASM is for SecOps or cloud-centric platform teams already deep in the Datadog ecosystem. If you aren't a Datadog observability shop already, ASM is a non-starter because its value hinges on correlating with APM traces and logs.
**Real Cost & Model:** Semgrep SaaS starts around $4-8 per developer per month on annual commits for their Teams tier. The hidden cost is the 10-15 hours a week of senior engineer time needed to write, tune, and maintain custom rules for your framework and false positives. Datadog ASM's pricing is opaque and consumption-based; in our proof-of-concept, enabling it on our top 50 services added ~18-22% to our existing Datadog APM bill. That's the real hidden cost.
**Integration & Operational Burden:** Integrating Semgrep's CLI into CI is a one-day affair. The real work is the ongoing triage burden on developers; you'll need to build a Slack bot and dashboard culture to keep findings from rotting. Datadog ASM deploys via a library or sidecar, which is trivial, but you then inherit the operational headache of runtime blocking. We found tuning its threat detection to avoid blocking legitimate traffic was a full-time job for a SRE.
**Where It Breaks:** Semgrep's static analysis fundamentally cannot see runtime dependencies, secrets in your cloud provider, or business logic flaws. It's a scanner, not a monitor. Datadog ASM, conversely, cannot see code that isn't deployed. We watched it miss a critical library vulnerability for weeks because the vulnerable endpoint was not in active use; a simple SAST check would have flagged it on day one.

I'd recommend Semgrep if your primary goal is to stop known vulnerabilities (like in OWASP Top 10) from ever reaching production and you have developer bandwidth to manage it. Pick Datadog ASM only if you're already all-in on Datadog and your main threat model is runtime attacks on already-deployed code. To make this clean, tell us your team size for managing this tool and whether you have a dedicated cloud security person.


Skeptic by default


   
ReplyQuote
(@danielm)
Honorable Member
Joined: 2 months ago
Posts: 453
 

You hit the nail on the head about the Datadog tax. That 18-22% uplift on the APM bill is the real sticker. It's a classic vendor lock-in play: get you on the metrics, then the logs, then the APM, and suddenly every new feature is just a consumption-based line item tacked onto your existing anchor. Their pricing isn't opaque by accident; it's by design. You only find out the true cost after you're already committed to the integration work.


— skeptical but fair


   
ReplyQuote
(@ci_cd_crusader_v2)
Honorable Member
Joined: 5 months ago
Posts: 512
 

Exactly. That opaque, consumption based model is the entire reason I won't touch their platform, even for runtime analysis. You don't just pay the 20% ASM uplift, you pay for every single scan and alert it triggers against your existing, already-paid-for APM data. It turns your own traffic into a meter you're constantly feeding.

You can achieve the same runtime insight for a fraction of the cost with a properly configured open telemetry pipeline and some simple, focused tooling. But that doesn't come in a shiny box with sales engineers, so teams just accept the tax.


null


   
ReplyQuote