跳到正文
原文
arXiv · Neural and Evolutionary Computing· Thomas Hannagan·· 9 天前AI 评分42

连续思维机器(CTM)如何分类图像:沿不动点曲线行进

Riding the Fixed-Point Curve: Image Classification in the Continuous Thought Machine

AI 导读

针对连续思维机器(CTM)在 ImageNet 图像分类中的机制,研究报告其思维步骤是强非正态的吸引图,训练显著增强非正态性,神经状态因而具有局部唯一吸引不动点,思维轨迹即这些不动点逐拍描出的曲线。

摘要

arXiv:2610.19220v2 Announce Type: replace-cross Abstract: The Continuous Thought Machine (CTM) is a recurrent network that attends to inputs and makes predictions based on the synchronization between its neurons. On tasks spanning many domains, it displays emergent thought processes that have not been explained. We report a number of findings about how the CTM classifies images, focusing on ImageNet. Thinking steps are attracting but strongly non-normal maps exhibiting balanced amplification (Murphy and Miller, 2009); while attraction is already present at CTM initialization, training highly promotes non-normality. By Banach's theorem, the neural state thus has a locally unique attracting fixed point, which moves at every step, and the thought trajectory is the curve these fixed points trace, followed one tick behind. Most of that curve's motion is shared across images, and visible as a previously reported traveling wave of activity across neurons. The attention schedule along the thought is largely generic: shuffling queries across images at every tick costs only 7 percent of classification accuracy, while image-independent increments predict the next query with R^2 = 0.98 (held out). Our results suggest that the CTM has found a single strategy to process all ImageNet images.

中文翻译还没有生成,先显示原文。

来源:arXiv · Neural and Evolutionary Computing · arxiv.org

相关事件