Skip to content
Notifications
Clear all

Switched from Checkmarx to Veracode, here's why it's a mixed bag

1 Posts
1 Users
0 Reactions
2 Views
(@cost_analyst_ray)
Reputable Member
Joined: 5 months ago
Posts: 138
Topic starter   [#18152]

After an exhaustive nine-month evaluation and a six-figure procurement process, our organization transitioned our primary static and dynamic application security testing (SAST/DAST) workload from Checkmarx to Veracode. The impetus was a corporate mandate to consolidate tooling and ostensibly reduce total cost of ownership. While the technical and operational outcomes are nuanced, the financial and resource allocation implications are stark and, in my view, underexplored in most comparative analyses.

The primary driver for the switch was the perceived efficiency of Veracode's cloud-native, platform-based model versus Checkmarx's on-premise-optional but often infrastructure-heavy deployment. The promise was a shift from capital expenditure to operational expenditure, with improved scalability. In practice, the cost structure is a significant mixed bag.

**The Positive (Cost & Operational Efficiency):**

* **Elimination of Scanner Infrastructure Costs:** With Checkmarx, we maintained a dedicated cluster of scan engines (m5.2xlarge EC2 instances, consistently running). Veracode's cloud-based scanner removes this entirely.
* **Previous Annual Cost (AWS List Prices):** 6 instances * $0.384/hr * 24 hrs * 365 days = **$20,247**
* **New Annual Cost:** $0. This is a clear, tangible saving.

* **Simplified Licensing and Administration:** The move from a concurrent license model (Checkmarx) to a consumption-based model (Veracode) reduces administrative overhead. We no longer manage license queues or capacity planning for peak scan periods.
* **Estimated FTE Savings:** ~0.2 FTE for infrastructure/queue management. Valued at approximately **$25,000** annually in fully loaded costs.

**The Negative (Unanticipated Cost & Performance Drag):**

* **Pipeline Integration and Scan Duration:** Veracode's cloud-based scans introduce variable latency. Our median scan time increased by 40%. This has a direct, calculable impact on developer productivity and pipeline resource consumption.
* **Example Calculation:** A baseline 10-minute scan now takes 14 minutes. For a team of 100 developers averaging 20 pipeline scans/day, that's an additional 800 developer-minutes lost per day. Quantifying this at a conservative rate yields a significant annualized productivity tax.

* **The "Policy Engine" Tax:** Veracode's enforced policy model, while good for compliance, creates a friction cost. Flaw severity thresholds that block pipelines lead to iterative, partial scans as developers attempt to pass the gate. This multiplies the scan time cost mentioned above.
* **Data Point:** Our "scan-to-clean" iteration count increased by 60% compared to our more configurable Checkmarx workflow, directly consuming more of our purchased Veracode credits.

* **Opaque Consumption Forecasting:** While Checkmarx had a fixed annual price, Veracode's credit consumption is volatile. One critical vulnerability discovered late in a sprint can trigger multiple rescan events, making quarterly budget forecasting challenging. Our Q1 consumption overshot projections by 35%.

**Technical Configuration Nuance:**
The shift required a non-trivial pipeline reconfiguration. Below is a simplified comparison of the Jenkins pipeline SAST stage.

```groovy
// Checkmarx (CxSAST) - On-demand, engine-based
stage('SAST - Checkmarx') {
steps {
withCredentials([...]) {
sh 'java -jar CxConsolePlugin.jar scan [...] --engine-configuration "Local"`
}
}
}

// Veracode - API-driven, cloud-based
stage('SAST - Veracode') {
steps {
sh '''
# 1. Package artifact
# 2. Upload via API (curl)
# 3. Poll for scan status (while loop, 30s intervals)
# 4. Pull results (curl)
# 5. Enforce policy via local script
'''
}
}
```
The Veracode approach adds more "glue code" and external dependencies (curl, jq, custom policy scripts) to our pipeline, increasing maintenance liability.

In summary, the direct infrastructure savings are real and immediately visible on the cloud bill. However, they are partially—and in some quarters, wholly—offset by the increased indirect costs in developer time, pipeline complexity, and unpredictable credit consumption. The total cost of ownership equation is far more balanced than the vendor's initial analysis suggested. For organizations considering a similar move, I urge you to model not just the list prices and server costs, but the full lifecycle cost of a single scan through to remediation, including the human and time factors. The financial implications reside as much in your payroll and lost opportunity costs as they do in your AWS or Veracode invoice.

Show me the bill.


CostCutter


   
Quote