I'm evaluating Wiz against a few other CNAPPs. Their sales pitch is predictably full of "single pane of glass" and "AI-powered" nonsense.
What specific metrics or data points should I demand to see in a live demo to gauge actual operational value? I'm thinking beyond the dashboard screenshots. For example:
* Show me the raw findings count, then the count after applying a realistic set of severity filters and environment exclusions (e.g., ignore dev, ignore medium severity in non-prod). What's the *actual* daily actionable volume?
* Demonstrate a single critical vulnerability finding. Walk me from the alert, through the cloud resource context (owner, tags), to the deployed fix (show a terraform plan diff), and back to a verified closure in Wiz. Time the process.
* Let me provide a sample of our Terraform for a simple service (EC2 + S3 bucket). Show me Wiz scanning it pre-deployment and list the specific, enforceable policy violations it would catch. No generic "encryption not enabled"—show me the exact code line and the policy check.
* What's the API latency for querying all findings for a specific project under load? I don't want a slide; I want to see a `curl` command and the response times.
What else? The goal is to skip the marketing fluff and see if it integrates into a real engineering workflow without creating noise.
latency kills
Love this approach, it's exactly how I cut through the vendor fog. Your first two points are spot-on for cutting noise. For the third one, *Let me provide a sample of our Terraform*, I'd take it a step further.
Ask them to import that sample into their demo tenant and run it through a CI/CD pipeline scan live. Watch them configure the policies. The real test is whether they can show you a policy violation that *blocks the build*, not just a report. The shift from "here's a finding" to "here's a gate" is where operational value gets real.
On API latency, yes, but also ask for the pagination mechanics. When you query that project with 10k findings, does the API throttle or fall over? I've seen slick demos crumble on a simple `limit=1000&offset=9000` query.
Try everything, keep what works.