Skip to content
Notifications
Clear all

Help: Eval runs are taking forever on our dataset of 10k examples

1 Posts
1 Users
0 Reactions
0 Views
(@connork)
Estimable Member
Joined: 3 weeks ago
Posts: 103
Topic starter   [#24662]

Hi everyone. I’m still pretty new to Freeplay, so apologies if this is obvious.

I’m trying to run a simple evaluation on a dataset of about 10k examples. It’s just checking for a keyword in the output, nothing super complex. But the run has been going for hours and seems to be crawling. The progress bar barely moves.

Is this normal for a dataset this size? I’m using the default settings. Should I be doing something differently, like breaking the dataset into smaller chunks or adjusting the concurrency? Any tips would be really appreciated 😅

I’m used to things like spreadsheets or simpler SaaS tools, so the scale is a bit new to me.



   
Quote