mirror of
https://github.com/open-multi-agent/open-multi-agent.git
synced 2026-10-22 02:53:10 -05:00
Jack Chen
b67fd39fda
The baseline section of docs/evaluation-ci.md enumerates every condition that makes a regression comparison warn and skip, and it was missing the one a threshold introduces: when it sets `minSamples` and either the current or the baseline aggregate is short, the comparison does not run. Record that condition and the consequence a gate author has to plan for, namely that a short baseline now yields a warning where it previously yielded a `regression` failure, so the guard loosens one check while it tightens another. Record the guard and `passSampleCount` in the changelog, set `minSamples` on the runnable offline-regression example so the option appears where a gate is actually configured, and credit the contributor. Follow-up to #602.