-
Notifications
You must be signed in to change notification settings - Fork 95
Ignoring results
Josh Hiles edited this page Dec 23, 2023
·
1 revision
Science is useful even when all you care about is the timing data or even whether or not a new code path blew up. If you have the ability to incrementally control how often an experiment runs via your Enabled
method, you can use it to silently and carefully test new code paths and ignore the results altogether. You can do this by setting Ignore((x, y) => true)
, or for greater efficiency, Compare((x, y) => true)
.
This will still log mismatches if any exceptions are raised, but will disregard the values entirely.
- Publishing results
- Controlling comparison
- Adding context
- Expensive setup
- Keeping it clean
- Ignoring mismatches
- Enabling or disabling experiments
- Ramping up experiments
- Running candidates in parallel (asynchronous)
- Testing
- Handling errors
- Designing an experiment
- Finishing an experiment
Sometimes scientists just gotta do weird stuff. We understand.