分数不是结构：大脑对齐与跨语言迁移
The Score Is Not the Structure: Brain Alignment and Cross-Lingual Transfer
相似度分数常被当作模型与大脑或跨语言之间共享结构的证据。作者在两组设定中检验分数在结构被移除或测量工具失效时还能读出什么：十七种语言的语法性探针迁移随语言距离变远而变差（r = -0.66），但探针自身准确率沿同一轴下降并在四种语言中处于随机水平；大脑对齐中训练目标把语言模型与功能磁共振响应的相似度从 0.10 提到 0.34（信度上限 0.54），而破坏大脑对应关系的目标仍能达到 0.31。作者据此建议在读对应分数前先测量没有对应关系时分数还剩多少。
arXiv:2610.03827v4 Announce Type: replace-cross Abstract: Similarity scores are often offered as evidence that a model shares structure with the brain or across languages. We ask what such a score reads when that structure is removed, or when the instrument measuring it does not work, in two settings. Across seventeen languages, a grammaticality probe transfers worse between more distant languages (r = -0.66). But the probe's own accuracy falls along the same axis and is at chance in four languages, four of the five most distant. Dropping them halves the explained variance, and because it also narrows the range of distances, the design cannot say how much of the gradient is the instrument. Counting the 272 language pairs as independent gives p = 0.0006 for a steering effect that is null when the seventeen languages are the unit (p = 0.155). In brain alignment, a training objective raises a language model's similarity to fMRI responses from 0.10 to 0.34 (reliability ceiling 0.54), yet targets with the brain correspondence destroyed still reach 0.31. A shuffled target scores about k/n against the real one, for rank k and n sentences, a baseline that can be computed before any model is trained. Both interventions work, yet we detect no distance-graded steering effect and no syntactic benefit from alignment. Before reading a correspondence score, measure how much of it survives without the correspondence.
中文翻译还没有生成，先显示原文。
来源：arXiv q-bio.NC 预印本 · arxiv.org