跳到正文
原文
arXiv · Neural and Evolutionary Computing· Pengfei Sun, Jascha Achterberg, Zhe Su, Dan F. M. Goodman, Danyal Akarca·· 8 小时前AI 评分45

利用异质性延迟实现低比特神经网络的高效计算

Exploiting heterogeneous delays for efficient computation in low-bit neural networks

AI 导读

在前馈脉冲神经网络中联合学习权重与延迟,异质性延迟使权重压缩超过一个数量级仍保持竞争性能。

摘要

arXiv:2510.27434v2 Announce Type: replace Abstract: Neural networks rely on learning synaptic weights. However, this overlooks other learnable neural parameters. One such parameter is delay: neurons communicate asynchronously with heterogeneous transmission delays. We propose that, rather than a cost to minimize, this heterogeneity supports computation when task-relevant information unfolds over time. We test this hypothesis by jointly learning weights and delays at different precisions in feedforward spiking neural networks. Delay heterogeneity supports competitive performance on neuromorphic benchmarks while compressing weights over an order of magnitude more aggressively than typically studied weight-only networks. Performance depends on task-matched delay distributions, with temporally complex tasks selectively relying on longer delays. These benefits persist under explicit delay constraints, while neural time constants only partially substitute for long delays. Our results connect the temporal structure of data with efficient model design, highlighting temporal heterogeneity as a computational resource with implications for embodied intelligence and neuromorphic hardware.

中文翻译还没有生成,先显示原文。

来源:arXiv · Neural and Evolutionary Computing · arxiv.org

相关事件