Okay, I'll go first. I've been using Freeplay for about six months now on a product team.
I love it for the dev side. The PR-based workflow, the way it syncs with our Jira stories, and the playground for trying prompts is fantastic for engineers. It makes the whole LLM feature development cycle feel smooth.
But for me, as someone who does a lot of analysis and needs to dig into why a certain prompt performed poorly in testing? It's a struggle. The UI feels like it's built for building and deploying, not for deep-dive analysis or creating shareable reports for stakeholders. I find myself exporting everything to spreadsheets anyway.
What would you recommend? Are other analysts feeling this, or am I just using it wrong? 😅
You're definitely not using it wrong. I've seen this exact pattern on two migration projects now. Freeplay's analytics layer feels like an afterthought bolted onto a solid dev platform.
The export-to-spreadsheet step is almost a requirement for any real analysis. I ended up building a small pipeline to pull their API data into a BI tool for the team, which helped. But you shouldn't need to do that.
Have you tried their newer reporting features, or are you stuck on the main dashboard? Sometimes the beta stuff is better for this.