Model lineage
Random initialization; no third-party pretrained weights. The documented revision is dbe5f102. Training used config/native-85m.yaml and the same dataset revision as Native 25M.
Architecture
d_model=640, 14 layers, 10 query heads, 2 KV headsd_ff=1920, context 2,048, RoPE, RMSNorm, SwiGLU- 86,446,464 tied parameters
Training
160 steps over 10,485,760 processed tokens on Tesla T4 hardware; 994.72 s wall time and 2,580.41 MB peak VRAM. The exact-resume probe reported a maximum weight difference of 0.0 and final training loss of 6.8362.
This was a shorter scaling experiment. More parameters alone did not produce better held-out BPB than the 25M checkpoint, which saw more data. Do not describe 85M as a stronger assistant.
Use and limitations
Suitable for scaling comparisons and reproducibility studies. Not suitable for production chat, coding, security advice or high-stakes use. It is not instruction-tuned.