https://www.zhumengyao.com/scidraft/tags/scaling/Recent content in Scaling on SciDraft | A Hugo ThemeHugoenMon, 21 Sep 2026 15:02:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-loss-by-model-size-table/Mon, 21 Sep 2026 15:02:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-loss-by-model-size-table/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>A scaling study compares models of different sizes trained on the same token budget. If the loss falls smoothly as capacity grows, the family is in a regime where parameters still buy accuracy, and the fall can be summarised as a power law in the parameter count rather than reported as a list of separate runs.</p>