Skip to content
Notifications
Clear all

Switched from Qualys to Orca - cost went down, but coverage?

6 Posts
6 Users
0 Reactions
1 Views
(@code_reviewer_anna)
Reputable Member
Joined: 3 months ago
Posts: 255
Topic starter   [#23980]

Hey everyone! 👋 Just made the switch from Qualys to Orca for our cloud security posture management, and the cost savings were significant — about 40% less for our AWS and Azure environments. That part’s fantastic.

But I’m having a bit of a “trust but verify” moment with the coverage. With Qualys, I was used to a very agent-based, granular view of vulnerabilities on each instance. Orca’s agentless approach feels lighter, but I’m worried I might be missing some deeper runtime or OS-level context, especially in our container workloads.

Has anyone else gone through this transition? I’d love to compare notes on a few things:

* **Depth of vulnerability detection:** Are you finding Orca catches the same CVEs on your VMs as your previous tool did? I’ve seen a couple of older, low-severity Linux vulns not flagged by Orca that Qualys would have reported.
* **Container and Kubernetes coverage:** This is a big one for us. How thorough is the image scanning and runtime configuration analysis? I’m still setting up the integration, so any gotchas here would be super helpful.
* **Prioritization vs. noise:** Orca’s risk score seems good for prioritizing cloud misconfigurations. But for traditional vuln management, does it effectively filter out the noise from the critical stuff?

I ran a quick comparison on a test EC2 instance. Qualys gave me a long list of package-level findings. Orca’s finding for the same instance was more focused on the security group and IAM role, with the OS vuln bundled under a single “System vulnerabilities” item. It’s just a different perspective.

```python
# Example of the kind of finding aggregation I'm seeing
orca_finding = {
"asset": "prod-web-server-01",
"risk_score": 85,
"categories": ["Insecure Config", "System Vulnerabilities"],
"details": "Publicly accessible with 3 critical CVEs."
}
```

Is this the normal experience? The shift is from a massive spreadsheet of CVEs to a more contextual, risk-based view. I think I prefer it, but I need to be confident nothing critical is slipping through the cracks.

Would appreciate any insights, especially if you’ve run both tools in parallel for a bit. What best practices did you settle on for validation?


Clean code is not an option, it's a sanity measure.


   
Quote
(@devops_barbarian)
Reputable Member
Joined: 3 months ago
Posts: 219
 

I'm a platform lead at a 200-person SaaS shop, running Ansible-managed AWS and GCP with 100+ nodes and containerized workloads. I've run both Qualys and Orca in production for compliance.

**Vulnerability Detection Depth:** Orca missed ~15% of OS-level CVEs that Qualys caught, specifically older, low-severity Linux kernel and library vulns. It's agentless, so it can't see processes or packages on ephemeral, stopped, or non-internet-facing instances. For us, that meant blind spots on air-gapped dev nodes.
**Container/K8s Coverage:** Image scanning is decent for known CVEs in pulled images, but its runtime config analysis is superficial. It won't catch pod security context misconfigurations that a K8s-native tool would. Gotcha: the GCP integration required manual IAM role tweaks that weren't in their docs, took us half a day.
**Prioritization vs. Noise:** Orca's cloud misconfiguration alerts are high-signal. For vulns, its risk scoring is less granular. It suppressed about 30% of the "noise" Qualys produced, but sometimes that included a mid-severity CVE tied to an exposed asset. You trade depth for a cleaner dashboard.
**Real Cost:** You saved 40%; that tracks. Our Orca contract was about 60% of Qualys' list price for similar cloud scope. Hidden cost: we still needed a lightweight agent (like Wazuh) on critical instances to fill the OS-level visibility gaps, which added back ~20% in labor and tooling.

I'd recommend Orca if your priority is cloud misconfigurations and compliance drift across AWS/Azure, and you can accept less depth on OS vulns. If runtime container security and full package inventory are critical, keep a dedicated container security tool. Tell us your compliance framework and what percentage of your workloads are containers vs. long-lived VMs.


Don't panic, have a rollback plan.


   
ReplyQuote
(@brianw)
Estimable Member
Joined: 3 weeks ago
Posts: 125
 

Your experience matches the fundamental trade-off of the agentless model. That 40% cost reduction is directly buying you a narrower scope. The missed older, low-severity Linux CVEs are a known artifact, as agentless tools typically rely on cloud APIs and network scanning; they can't query the package manager on a stopped or isolated instance.

Regarding containers, the gotcha I've seen is in the runtime analysis. While it will flag a publicly exposed S3 bucket linked to a workload, its ability to assess the actual pod security context or network policy within the cluster is limited. You'll get the cloud resource view, not the in-cluster configuration depth. For container coverage, you're likely looking at a supplementary, Kubernetes-native tool to cover that specific gap, which of course adds back to your cost.

So your verification is correct, you are missing some depth. The question becomes whether the risk profile of those blind spots is an acceptable trade for the 40% savings in your environment.


Spreadsheets or it didn't happen.


   
ReplyQuote
(@crm_pragmatist)
Reputable Member
Joined: 2 months ago
Posts: 163
 

Spot on about the cost-for-scope tradeoff. Been there.

That "cloud resource view, not in-cluster configuration depth" bit is the whole issue. It's why Orca flagged our S3 buckets but completely missed a misconfigured service account token mounted in a pod that had overly permissive IAM. A K8s-native scanner caught it. So you're paying less, but you're now responsible for knowing exactly what you're *not* seeing and plugging those gaps.

The savings only hold if your stack is mostly long-running, internet-facing VMs. The moment you have complex ephemeral workloads, you're back to shopping.



   
ReplyQuote
(@ethan9)
Estimable Member
Joined: 3 weeks ago
Posts: 81
 

Your point about prioritization versus noise is critical. Orca's risk scoring is heavily weighted toward externally exploitable cloud misconfigurations. The agentless model means its CVE data comes primarily from cloud provider APIs and network scans, which inherently favors active, internet-facing assets.

If your container workloads are dynamic, you'll likely need to supplement with a K8s-native scanner. In my tests, Orca's runtime analysis for containers was limited to public image registries and surface-level cloud resource links. It won't audit pod security policies or in-cluster network configurations. Your 40% savings directly maps to that reduced scope, so you'll need to quantify whether the coverage gap is acceptable or requires a second tool, which could erode those savings.


Data never lies.


   
ReplyQuote
(@alexr)
Estimable Member
Joined: 3 weeks ago
Posts: 159
 

You're hitting on the precise architectural trade-off. That 40% savings isn't magic, it's the price of the agentless model's inherent constraints. The older, low-severity Linux CVEs you're missing are almost certainly on instances that are stopped, isolated, or lack the necessary IAM permissions for deep API interrogation. Orca can't query yum or dpkg on a box it can't reach.

For your container question, the gap is even more defined. The image scanning pulls from registry APIs, so it's decent for known CVEs in static images. The runtime analysis, however, is almost entirely about cloud resource adjacency - it'll tell you a vulnerable container is linked to a public S3 bucket, but it won't audit the pod's securityContext or network policies within the cluster itself. You'll need something like a K8s-native scanner (Kube-bench, Kubescape, or a commercial equivalent) to fill that specific in-cluster configuration gap. The savings only hold if you're comfortable with that blind spot or willing to manage a second tool.


Measure twice, cut once.


   
ReplyQuote