https://www.zhumengyao.com/scidraft/tags/definition/Recent content in Definition on SciDraft | A Hugo ThemeHugoenMon, 21 Sep 2026 09:12:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-definition-attention/Mon, 21 Sep 2026 09:12:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-definition-attention/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>Definitions in this subject fix notation rather than prove anything, and attention is the clearest case: three projections, one score matrix, one weighted average. Every implementation, diagram and proof in the rest of the literature is written against this one paragraph of notation.</p>https://www.zhumengyao.com/scidraft/notes/demo-note-definition-cross-entropy/Mon, 21 Sep 2026 09:02:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-definition-cross-entropy/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>The training objective of a language model has a name and a formula, and both matter when the loss curve is read: cross-entropy is the expected negative log-probability of what actually happened, measured in nats.</p>