Commit Graph
4 Commits
Author SHA1 Message Date
ruv 2c3a924231 fix(training): export the real contrastive lossHistory/duration, not a no-op baseline pass
scripts/train-ruvllm.js ran two separate computations during contrastive
pretraining: ContrastiveTrainer.train() (a baseline pass that computes loss
but never updates the encoder) and a hand-written loop that actually applies
gradient updates to encoder.w2. The exported training-metrics.json took
lossHistory and contrastive.durationMs from the first (no-op) pass instead
of the second (real) one, so the published curve was flat/meaningless
(~0.1352 for all 20 epochs) and the duration was ~30x too short.

This did not affect finalLoss/improvement or the held-out temporal-triplet
accuracy metric published for this model on HuggingFace
(ruvnet/wifi-densepose-pretrained) -- those already came from the real loop.
It only affected the diagnostic curve/duration anyone auditing convergence
from the published JSON would see.

Also: config.json's training.steps field (epochs * triplets, technically
consistent but reads like an optimizer-step count) is now reported as
separate epochs/tripletUpdatesPerEpoch fields, and the exported version
bumped 1.0.0 -> 2.0.1 to match the "v2" naming already used elsewhere for
this file set.

Verified by re-running against the real capture
(data/recordings/overnight-1775217646.csi.jsonl): lossHistory now shows a
genuine decreasing curve (0.1037 -> 0.0654 across 20 epochs, matching the
already-published finalLoss exactly), durationMs reports the real ~40s
gradient-loop time instead of ~12s.

Model card updated with the same disclosure (docs/huggingface/MODEL_CARD.md)
plus a real, previously-undisclosed EWC forgetting-rate figure (32.97%,
present in training-metrics.json but not surfaced in the human-readable
card) and a corrected repro-script pointer.
2026-09-09 11:26:17 -04:00
ruv 828d0599d7 fix: skip triplet JSON export for large datasets (>100K)
JSON.stringify fails on 1M+ triplets. Training succeeded (33.3%
improvement) but export crashed. Now skips export when >100K triplets.

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-04-03 09:37:08 -04:00
ruv ade0fe82f6 fix: ruvllm pipeline — 7 critical fixes, all metrics improved
Before → After:
- Contrastive loss: -0.0% → 33.9% improvement
- Presence accuracy: 0% → 100%
- Temporal negatives: 0 → 22,396
- Quantization 2-bit: 16KB (4x) → 4KB (16x)
- Quantization 4-bit: 16KB (4x) → 8KB (8x)
- Training samples: 236 → 2,360 (10x augmentation)
- Triplets: 249 → 23,994 (96x more)

Fixes: gradient descent on encoder weights, temporal negative
threshold 30s→10s, PresenceHead (128→1 BCE), bit-packed
quantization, data augmentation (interp+noise+cross-node),
Xavier/Glorot init with batch normalization, live data collection

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-04-02 22:40:48 -04:00
ruv a73a17e264 feat: ADR-071 ruvllm training pipeline — contrastive + LoRA + TurboQuant
5-phase training pipeline using ruvllm (Rust-native, no PyTorch):
1. Contrastive pretraining (triplet + InfoNCE, 5 triplet strategies)
2. Task head training (presence, activity, vitals via SONA)
3. Per-node LoRA refinement (rank-4, room-specific adaptation)
4. TurboQuant quantization (2/4/8-bit, 6-8x compression)
5. EWC consolidation (prevent catastrophic forgetting)

Exports: SafeTensors, HuggingFace config, RVF, per-node LoRA, quantized
Validated: 249 triplets, 37,775 emb/s, 100% presence accuracy on test data
Target: <5 min training on M4 Pro, <10ms inference on Pi Zero

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-04-02 22:27:24 -04:00