[Feature]: New sweep configuration method grid_shuffled

[RylanSchaeffer]

Description

W&B's sweep enables specifying a sweep method. I personally use grid the most. However, one downside of grid sweeping is that results are produced sequentially as determined by the order of parameters in the sweep. I would instead strongly prefer for the grid to be swept in random order for me to get a sense of the results before the sweep has completed.

By analogy, I don't want a picture to fill in top-down or bottom-up; I'd rather the pixels appear in random order so I can get a sense of the overall structure of my results as the runs trickle in.

Suggested Solution

Create a grid_shuffled method that does a grid sweep albeit randomly permuting the order of the runs.

[exalate-issue-sync]

Bonnie Shen commented:
Hello @RylanSchaeffer! Thanks for writing to us! Hope you are having a lovely day!
I also think this is a good feature to have. And I'm happy to file a feature request on your behalf.

[dmitryshribak]

Also very interested in this feature!