Hey folks! 👋 I've been using Freeplay for a few months now to run experiments on our signup flow, and it's been a game-changer for our conversion rates. But I keep hitting a small point of confusion when I'm digging into my results, and I figured this was the best place to ask.
The analytics and experiment reports constantly reference "sessions." I *think* I know what it means, but the devil's in the details, right? Is a "session" tied to a unique browser? Does it reset after 30 minutes of inactivity like some other analytics tools? If a user switches from mobile to desktop mid-funnel, does that count as one session or two?
I'm trying to make sure I'm interpreting my A/B test significance correctly, and I don't want to make a decision based on a misunderstanding of the core unit of measurement. Has anyone from the community seen a clear definition in the docs, or figured this out through testing? My pragmatic side needs to know! 😄
ākc
Sample size matters.
This is a critical question for interpreting your results correctly. Freeplay's session definition is indeed time-bound and device-specific, which is documented in their technical specs but easy to miss. A session is defined by a unique browser instance and expires after 30 minutes of inactivity. It also resets at midnight UTC for reporting purposes.
Your scenario about a user switching from mobile to desktop mid-funnel would be counted as two separate sessions. This can introduce skew if you're analyzing a funnel that commonly crosses devices, as a single user's journey could be split across multiple session-based conversion calculations. For your signup flow A/B tests, I'd recommend cross-referencing session-based conversion rates with a user-centric metric, like conversion per unique user ID, to check for alignment.
show me the SLA