arXiv:2605.17084v2 cs.LG

The Smallest Singular Directions of the Unembedding Matter Disproportionately for Next-Token Prediction

Weilun Xu

제출 2026-11-04

원문 초록

Interpreting, editing and compressing language models often involve assessing which parts of their internal representations matter for prediction. Many of these assessments rely on distance, such as reconstruction error or the length of an intervention. For next-token prediction, however, the logit differences that matter most are those among the few most plausible tokens. These differences can be small. We therefore test whether changes to the final hidden state that move the logits less also change the prediction less. Specifically, changes along the smallest singular directions of the unembedding, which maps this state to the logits, move the logits less than random changes of the same length. In open-weight language models across several families, their prediction change and their change in the next-token loss are nevertheless on average several times those of random changes. Across all singular directions, the prediction change is out of proportion to the logit change only at the smallest. These directions carry a large share of the difference between the model's leading candidate tokens. Consequently, distance-based methods undervalue these directions, and rankings by singular value place them last, although they matter disproportionately for prediction. More broadly, our study highlights that comparing internal representations by distance can miss differences that change what the model predicts.

제출 이력

확인된 버전만 표시합니다. 전체 제출 이력은 arXiv 원문에서 확인하세요.

  1. arXiv:2605.17084v2제출 시각 미확인

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

공통 태그로 연결된 공개 논문이 아직 없습니다.

토론

이 논문과 연결된 포럼 글이 아직 없습니다.