MIDAS:基于图像块输入特定的可微分架构搜索
MIDAS: Mosaic Input-Specific Differentiable Architecture Search
MIDAS 用自注意力生成输入特定的动态架构参数,在 CIFAR-10 上达 97.42% top-1。
arXiv:2602.17700v2 Announce Type: replace-cross Abstract: Differentiable Neural Architecture Search (NAS) provides efficient, gradient-based methods for automatically designing neural networks, yet its adoption remains limited in practice. We present MIDAS, an approach that modernizes DARTS by replacing static architecture parameters with dynamic, input-specific parameters computed via self-attention. To improve robustness, MIDAS (i) localizes the architecture selection by computing it separately for each spatial patch of the activation map, and (ii) introduces a parameter-free, topology-aware search space that models the two-edge node topology during search. We evaluate MIDAS on the DARTS, NAS-Bench-201, and RDARTS search spaces. In DARTS, it reaches 97.42% top-1 on CIFAR-10 and 83.38% on CIFAR-100. In NAS-Bench-201, it discovers optimal or near-optimal architectures. In RDARTS, it achieves the best reported performance among the compared methods on two of four search spaces on CIFAR-10. We further analyze why MIDAS works, showing that patchwise attention improves discrimination among candidate operations and that the resulting input-specific parameter distributions are class-aware.
中文翻译还没有生成,先显示原文。
来源:arXiv · Neural and Evolutionary Computing · arxiv.org