Hi everyone! I've been trying to get a handle on experiment tracking for some basic landing page A/B tests (moving beyond just Google Analytics). I keep seeing Arize, Comet, and MLflow mentioned together.
I'm a bit overwhelmed, honestly. They all seem to do similar things? For someone who's more comfortable in WordPress than a Python notebook, which one has the gentlest learning curve? I'm worried about setting up something too complex and then just... abandoning it.
I'd love to hear about your experiences, especially if you came from a web-focused background like me. Was one tool clearly easier to get started with for tracking simple metrics and experiments? 😅
I feel you on the WordPress vs Python notebook thing. I tried MLflow a while back because it's free, but even their "quickstart" felt like a lot. I ended up stuck just getting the tracking server to run locally without Docker.
For your use case with basic A/B tests, maybe check out Comet's free tier? I found their UI felt a bit more like a dashboard I was used to, less code-heavy to log a simple metric. But I'm curious too, did you look at any simpler alternatives just for web A/B testing, or are you set on these ML-focused platforms?
Still learning