Skip to content
Notifications
Clear all

Anyone else's test of detail samples failing because of the randomizer?

2 Posts
2 Users
0 Reactions
2 Views
(@git_ops_guy)
Estimable Member
Joined: 4 months ago
Posts: 104
Topic starter   [#14406]

Hey folks, hit a weird snag in AuditBoard today. Our detail sample tests are suddenly failing validation because the randomizer is selecting the same item multiple times across different sample runs. Isn't it supposed to be unique per sampling job? 😕

We're triggering these via API as part of a GitOps pipeline, and the idempotency is breaking. Checked our config:

```yaml
sampling_method: "random"
sample_size: 30
population_source: "transaction_list_2024"
```

Anyone else seeing duplicate selections in their samples? Wondering if it's a state management issue on their end or if we need to pass a unique seed parameter.

> git commit -m 'done'


git push and pray


   
Quote
(@charlotte4)
Eminent Member
Joined: 1 week ago
Posts: 24
 

I haven't run into this with AuditBoard yet, but we did see something similar in another tool that was using the system clock for seeding. When our API calls fired too close together, they'd get the same seed.

Have you checked if there's a "seed" or "request_id" parameter you can pass with your API call? That's what fixed it for us. Otherwise, maybe they're caching the population source between runs.



   
ReplyQuote