Skip to main content

Experiments

Each experiment page records one model built end to end with these recipes: the data, every training run including the ones that failed, the evaluation, and what was learned. Pages are grouped by the type of model, so experiments on the same architecture stack up and can be read side by side.

Model typeWhat it isCatalog entryExperiments
Decoder LLMdecoder-only transformer, full attention in every layertransformer: Qwen3-0.6B, 1.7BJarvis inner-thought router (Qwen3-0.6B, chosen)
Hybrid LLM (Gated DeltaNet)Gated DeltaNet linear-attention layers mixed with full-attention layershybrid: Qwen3.5-0.8B, 2Bcompared in the router experiment (Qwen3.5-0.8B)
SSMstate-space layers only (Mamba)not in the catalog yetnone
Speech modelsa VITS voice (Piper); a small head on frozen speech features (openWakeWord)tts_piper, wakewordJarvis voice agent (wake word and voice)

A new experiment goes under the type of the model it ships. A type without a page gets one with its first experiment: an intro under website/intros/experiments/<type>/, listed in scripts/sync.py and sidebars.js.

Source: handwritten. This page is generated; edit the source and run npm run sync.