Files
Jack Chen b67fd39fda docs: document the minSamples regression skip (#606)
The baseline section of docs/evaluation-ci.md enumerates every condition
that makes a regression comparison warn and skip, and it was missing the
one a threshold introduces: when it sets `minSamples` and either the
current or the baseline aggregate is short, the comparison does not run.
Record that condition and the consequence a gate author has to plan for,
namely that a short baseline now yields a warning where it previously
yielded a `regression` failure, so the guard loosens one check while it
tightens another.

Record the guard and `passSampleCount` in the changelog, set `minSamples`
on the runnable offline-regression example so the option appears where a
gate is actually configured, and credit the contributor.

Follow-up to #602.
2026-09-14 18:45:12 +08:00

5.0 KiB

Contributors

open-multi-agent is built by the people below. The contributor graph lists everyone who has landed a commit; this file records what each person contributed.

The project is maintained by YuanASI (Shenzhen YuanASI Technology Co., Ltd.); Jack Chen is the lead maintainer.

Opening your first PR gets you added here. See the contribution guide.

Framework features

  • @ibrahimkzmv (token budget, context strategy, dependency-scoped context, tool presets, glob, MCP integration, configurable coordinator, CLI, dashboard rendering, trace event types)
  • @apollo-mg (context compaction fix, sampling parameters)
  • @tizerluo (onPlanReady, onAgentStream)
  • @CodingBangboo (planOnly mode)
  • @Xin-Mai (output schema validation)
  • @JasonOA888 (AbortSignal support)
  • @EchoOfZion (coordinator skip for simple goals)
  • voidborne-d (OpenAI mixed-content fix, text-tool-extractor depth fix)
  • @NamelessNATM (agent delegation base implementation)
  • @MyPrototypeWhat (reasoning blocks, reasoning_effort, sampling parity, trace input/output)
  • @SiMinus (streaming reasoning events)
  • @matthewYang08 (OpenAI reasoning-to-text fallback)
  • @dvirarad (OpenAI-family adapter hardening)
  • @cat0825 (model routing policy, plan replay, structured shared-memory handoff)
  • @mvanhorn (checkpoint & resume)
  • @lesbass (run-level metrics rollup on TeamRunResult)
  • @tlysanhuo (trace span parent linkage)
  • @LambIessz (orchestrator cost budget, MessageBus persistence in checkpoints, retryable route fallback)
  • @Bobuyoucrypto (Windows bash timeout process-tree kill)
  • @green3sf (structured output refresh after an accepted verify revision)
  • @Zhongghaoming (evaluation gate minimum-samples guard)

Provider integrations

Examples & cookbook

Docs & tests