Skip to content
Notifications
Clear all

JFrog Xray after 12 months - honest review from a mid-market SaaS company

1 Posts
1 Users
0 Reactions
12 Views
(@cloud_cost_optimizer)
Reputable Member
Joined: 5 months ago
Posts: 157
Topic starter   [#13010]

After a 12-month implementation of JFrog Xray across our production and development Kubernetes environments, I have compiled a comprehensive review focusing on operational overhead, cost implications, and integration efficacy. Our organization operates a mid-market SaaS platform with approximately 150 microservices, utilizing AWS EKS and a mix of on-demand and reserved EC2 instances. Our primary objectives for Xray were CVE and license compliance scanning for container images and Helm charts, integrated into our CI/CD pipelines.

The initial setup and configuration required a non-trivial investment. The Helm chart for the Xray Kubernetes deployment, while functional, necessitated significant resource allocation adjustments to function reliably on our node types. Below is a snippet from our values.yaml override, which was critical for stable operation on `m5.2xlarge` reserved instances:

```yaml
xray:
common:
persistence:
size: 500Gi
server:
resources:
requests:
memory: "8Gi"
cpu: "2000m"
limits:
memory: "16Gi"
cpu: "4000m"
analysis:
resources:
requests:
memory: "4Gi"
cpu: "1000m"
limits:
memory: "8Gi"
cpu: "2000m"
```

From a cost optimization perspective, the financial impact breaks down into three primary categories:

* **Direct Licensing Costs:** Our subscription is based on a tiered model correlating to the number of Artifactory instances and scanning volumes. For our scale, this represented a predictable, though substantial, line item in our software budget.
* **Infrastructure Overhead:** The Xray components (server, indexer, analysis service) consumed considerable resources within our EKS cluster. Over the year, this translated to approximately 15-20% additional cluster capacity required, which had direct cost implications for our EC2 and EBS footprint. We mitigated this partially by leveraging Reserved Instance commitments for the underlying worker nodes.
* **Operational Efficiency Gains/Losses:** The automated blocking of deployments with critical CVEs in CI prevented several potential incidents. However, the scanning latency—averaging 90-120 seconds per image for a full scan—added non-negligible wait time to our pipeline, which, at scale, impacts developer productivity and compute resource utilization (e.g., Jenkins agents waiting idly).

The scanning accuracy and policy engine are robust. The ability to define policies based on security severity, license type, and component age integrated well with our FinOps and SecOps workflows. However, the depth of scanning can be a double-edged sword; the default "deep" scan provided exhaustive results but was often overkill for development-stage images, leading us to implement a two-tiered scanning strategy to optimize for speed in lower environments.

Major considerations for teams contemplating implementation:
* Perform a detailed capacity planning exercise for the Kubernetes deployment. The resource claims in the default Helm chart were insufficient for our production load.
* Model the indirect infrastructure costs (compute, storage) alongside the license fees. The total cost of ownership extends beyond the subscription.
* Design your scanning triggers and policies iteratively. A "scan everything on every push" approach will create pipeline bottlenecks and increase resource consumption exponentially.
* The integration with Artifactory is seamless, but the value is contingent on a mature artifact management and container registry discipline.

In conclusion, JFrog Xray delivers on its core promise of software composition analysis with high fidelity. The return on investment is positive from a risk mitigation standpoint, but it introduces measurable complexity and infrastructure cost that must be proactively managed, especially in a cloud-native, Kubernetes-centric environment where resource efficiency directly impacts the monthly bill.

-cc


every dollar counts


   
Quote