https://www.zhumengyao.com/scidraft/tags/example/Recent content in Example on SciDraft | A Hugo ThemeHugoenTue, 22 Sep 2026 07:05:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-example-attention-two-tokens/Tue, 22 Sep 2026 07:05:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-example-attention-two-tokens/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>The smallest interesting attention example has two positions and one head, which is enough for a full calculation with no matrix product larger than two by two.</p> <p>Working it at this size makes the two roles visible: the score decides how much the output at position two borrows from position one, and the value vectors set what is borrowed. With a causal mask, the first row has nothing to attend to but itself.</p>https://www.zhumengyao.com/scidraft/notes/demo-note-example-softmax-three/Mon, 21 Sep 2026 13:12:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-example-softmax-three/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>An example is where a formula stops being notation, and this one is small enough to check by hand: three scores, one softmax, three probabilities that must sum to one.</p> <p>The numbers below are the ones the companion snippet prints, so the arithmetic here and the output of a few lines of code can be compared directly.</p>