I've been asked to evaluate ThoughtSpot for a high-cardinality, time-series analytics use case. The marketing claims are around "search-driven" ad-hoc queries by business users.
My initial tests on a ~500M row dataset were mixed.
Pros:
* The natural language to SQL translation is fast. It handles vague phrases like "sales last quarter by region" correctly.
* The in-memory cache for repeated queries is effective. Response times drop significantly for warmed datasets.
Cons:
* The "self-service" model breaks down with complex joins. Our schema is a star schema with 8 dimensions. Business users without data modeling knowledge create runaway Cartesian products.
* The performance on truly novel, complex aggregations is no better than a well-tuned Presto/Trino cluster, but at a much higher cost per seat.
* Their "Live Connect" to our cloud data warehouse introduced network latency spikes, making the 1-second response claim unrealistic for us.
Key metric: For 95% of pre-defined reports, it's fine. For the 5% of truly ad-hoc, complex queries, the performance degraded by 3-5x compared to a direct, optimized SQL query run by an analyst.
Has anyone else done a head-to-head benchmark against something like Apache Superset or even a managed Looker setup on large datasets? I'm specifically interested in query latency and concurrency numbers. The sales demos always use clean, small datasets.
Data over opinions
I'm a data platform lead at a fintech scale-up handling about 2 billion rows in Snowflake, and we've had ThoughtSpot in production for 18 months for our sales and finance teams.
**Core Comparison**
1. **Target User Reality**: Mid-market to enterprise, but only for pre-modeled questions. It genuinely works for business users exploring a single, well-defined fact table. The moment they start dragging in multiple dimensions without understanding join paths, you'll get support tickets for "incorrect numbers." It's not a true ad-hoc tool for a complex schema.
2. **True Pricing Band**: List prices start around $95/user/month for the cloud edition with annual commitment. The significant hidden cost is the mandatory 4-8 weeks of professional services for initial modeling and deployment to make it usable. Your cloud data warehouse costs will also increase due to query patterns.
3. **Where It Clearly Wins**: Cached, repetitive queries on a stable model. For our 20 standard board and sales dashboards refreshed daily, it's reliable and sub-second. The search-to-SQL is impressive for simple, noun-driven queries like "total contract value by sales rep."
4. **Honest Limitation - Ad-Hoc Complexity**: Your 5% finding matches ours. For novel, multi-hop joins and complex aggregations, the performance is 3-5x slower than a tuned Presto cluster, and the SQL it generates is often inefficient. We've had to set up a separate process where analysts write direct SQL for these one-off questions.
**My Pick**
I wouldn't recommend ThoughtSpot for your described use case of high-cardinality, truly ad-hoc querying. It's a good cached dashboard and reporting tool for a stable set of business questions. For a clean recommendation, tell us the percentage of your user base that are genuine, unassisted business users versus data-savvy analysts, and what your tolerance is for pre-building those complex query patterns versus true self-service.
Stay grounded, stay skeptical.