Skip to content
Notifications
Clear all

Has anyone tried running ZPA connectors on Azure Spot VMs to save cost?

2 Posts
2 Users
0 Reactions
1 Views
(@claireb)
Estimable Member
Joined: 6 days ago
Posts: 59
Topic starter   [#15340]

I've been conducting a deep-dive analysis into the operational expenditure for our Zscaler Private Access (ZPA) infrastructure, specifically focusing on the connector deployment model within Microsoft Azure. A significant portion of our cloud costs is attributed to the persistent compute required for these connectors, which has led my team to explore more aggressive cost-optimization strategies beyond reserved instances.

The core question we're investigating is the viability and stability of deploying ZPA connectors on Azure Spot Virtual Machines. The potential cost savings, often cited as up to 90% compared to pay-as-you-go pricing, are extraordinarily compelling for a service that scales horizontally. However, the fundamental trade-off with Spot VMs is the possibility of eviction with a short notice period (typically 30 seconds), which could directly impact the availability of the ZPA service for our user base.

To structure the evaluation, I've begun outlining a comparison framework that considers the following critical dimensions:

* **Connector High-Availability Architecture:** How does the ZPA App Connector's inherent design for redundancy (e.g., provisioning multiple connectors in a segment) interact with sporadic, non-simultaneous Spot evictions? Can the controller efficiently re-provision or re-balancer load if one node is lost?
* **Eviction Impact Profile:** We need to quantify the user experience impact. Does a connector eviction result in:
* A brief interruption for active sessions routed through that specific connector?
* A seamless failover to another connector in the same segment, transparent to the end-user?
* Orphaned configuration states that require manual intervention?
* **Deployment & Automation Overhead:** Implementing this reliably would necessitate robust automation. This includes:
* Azure VM Scale Sets with Spot instances and a fallback policy to standard VMs.
* Integration of eviction notices (via Azure Metadata Service or Event Grid) with a scripted process to gracefully deregister the connector from the ZPA cloud and/or trigger a replacement.
* Enhanced monitoring and alerting specific to the eviction and health-recovery cycle.

Before we proceed to a proof-of-concept, I am keen to learn from the community's practical experiences. Has anyone implemented a production or significant test deployment of ZPA connectors on Azure Spot VMs (or analogous AWS Spot Instances/Google Preemptible VMs)?

I am particularly interested in empirical data or observations regarding:
* The actual frequency of evictions in your specific Azure region and for the chosen VM series.
* The real-world behavior of the ZPA service during and after an eviction event.
* Any modifications required to the standard connector deployment scripts or Azure Resource Manager templates.
* Whether the achieved cost savings justified the added complexity in operations and monitoring.


Method over hype


   
Quote
(@jazzcat)
Trusted Member
Joined: 1 week ago
Posts: 37
 

Spot eviction is the big one, yeah. Your point about the connector's HA design is key, but don't forget it's built for graceful failures, not forced 30-second terminations. The failover might handle it, but you could see a brief service hiccup or increased latency for users routed through that connector as sessions drop.

I'd add session persistence to your framework. What happens to active user sessions when a spot connector gets the eviction notice? Some real-time apps might not be thrilled. Might be fine for general web traffic, but could be rough for something like a database client over ZPA. Have you checked if the connector service can get a signal before Azure pulls the plug to start draining?


APIs > promises


   
ReplyQuote