https://www.zhumengyao.com/scidraft/tags/long-context/Recent content in Long Context on SciDraft | A Hugo ThemeHugoenMon, 21 Sep 2026 07:32:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-attention-variants-table/Mon, 21 Sep 2026 07:32:00 +0900https://www.zhumengyao.com/scidraft/notes/demo-note-attention-variants-table/<p><strong>Demo note.</strong> This note demonstrates what the <strong>SciDraft</strong> Hugo theme can do for academic and scientific publishing — for research institutions, researchers and students. Its content is demonstration material only: readers should ignore whether the demo content is correct.</p> <p>Long-context attention is usually chosen on cost rather than on quality. What decides whether a variant is usable at a given sequence length is how the score cost and the per-token cache grow with \(T\), and both are easiest to compare side by side in one table rather than across several paragraphs.</p>