跳到正文
原文
arXiv · Human-Computer Interaction· Yifang Wang, Rui Sheng, Erzhuo Shao, Yifan Qian, Haotian Li, Nan Cao, Dashun Wang·· 8 天前AI 评分47

从静态图到可交互界面:面向科学发现的 LLM 原生图表

Figures as Interfaces: Toward LLM-Native Artifacts for Scientific Discovery

AI 导读

研究者提出“LLM 原生图表”概念,让图表同时可被人阅读和机器寻址,每张图内嵌数据子集、分析操作与代码、可视化规范等完整溯源信息。基于图表与底层数据的双向映射,LLM 可追溯数据来源、生成代码扩展分析,并通过自然语言指令编排新可视化。以科学学领域为测试平台,作者称该混合语言—视觉界面能加速发现、提升可重复性并让推理过程透明,具体细节见论文附带的演示视频。

摘要

arXiv:2604.08491v3 Announce Type: replace Abstract: Large language models (LLMs) are transforming scientific workflows, not only through their generative capabilities but also through their emerging ability to use tools, reason about data, and coordinate complex analytical tasks. Yet in most human-AI collaborations, the primary outputs, figures, are still treated as static visual summaries: once rendered, they are handled by both humans and multimodal LLMs as images to be re-interpreted from pixels or captions. The emergent capabilities of LLMs open an opportunity to fundamentally rethink this paradigm. In this paper, we introduce the concept of LLM-native figures: data-driven artifacts that are simultaneously human-legible and machine-addressable. Unlike traditional plots, each artifact embeds complete provenance: the data subset, analytical operations and code, and visualization specification used to generate it. As a result, an LLM can "see through" the figure--tracing selections back to their sources, generating code to extend analyses, and orchestrating new visualizations through natural-language instructions or direct manipulation. We implement this concept through a hybrid language-visual interface that integrates LLM agents with a bidirectional mapping between figures and underlying data. Using the science of science domain as a testbed, we demonstrate that LLM-native figures can accelerate discovery, improve reproducibility, and make reasoning transparent across agents and users. More broadly, this work establishes a general framework for embedding provenance, interactivity, and explainability into the artifacts of modern research, redefining the figure not as an end product, but as an interface for discovery. For more details, please refer to the demo video available at www.llm-native-figure.com.

中文翻译还没有生成,先显示原文。

来源:arXiv · Human-Computer Interaction · arxiv.org

相关事件