HyperAIHyperAI

Command Palette

Search for a command to run...

LLMは跳躍できない

Tom Zahavy Oliver Nash

概要

我々は根本的に新しいものをどのように発見するのか。アルベルト・アインシュタインはモーリス・ソロヴィン宛の書簡において、発見を、感覚経験から公理への直感的な「跳躍」と、それに続く論理的演繹からなる循環的プロセスとして概念化した。生成AIは帰納(統計的パターンマッチング)を習得し、演繹(形式的証明)を急速に克服しつつある一方で、我々は、新規な説明的仮説を生成するアブダクションのメカニズムを欠いていると主張する。アインシュタインによる一般相対性理論の定式化を計算論的ケーススタディとして用い、「データ圧縮としての創造性」という一般的な理論(帰納)では、観測データが乏しい発見を説明できないことを示す。本ポジションペーパーは、現代の大規模言語モデルが、確立された前提から定理を証明する演繹的段階をもっともらしく実行できる一方で、それらの前提を定式化するために必要なアブダクティブな「跳躍」を構造的に行うことができないと論じる。我々は、シミュレーションから形式的公理への変換を、人工的な科学的発明における決定的なボトルネックとして特定し、物理的に一貫したマルチモーダルな世界モデルが、この隔たりを橋渡しするために必要な感覚的基盤を提供すると提案する。

One-sentence Summary

Google DeepMind researchers argue that large language models, though adept at induction and deduction, are structurally incapable of the abductive “jump” necessary to formulate novel explanatory hypotheses, and propose that physically consistent multimodal world models can provide the sensory grounding required to overcome this critical bottleneck in artificial scientific invention.

Key Contributions

  • The paper challenges the "creativity as compression" hypothesis by demonstrating that Einstein's formulation of General Relativity occurred without a pervasive error signal or abundant observational data, showing that statistical induction alone cannot explain such discoveries.
  • This work identifies the abductive leap, translating internal physical simulations into formal axioms, as the critical missing mechanism in current AI, and supports this claim by examining the sensory-grounding limitations of state-of-the-art automated discovery systems like the AI Scientist and AlphaEvolve.
  • It proposes that physically consistent, multimodal world models can provide the necessary sensory grounding for AI to perform the counterfactual simulations that drive abduction, offering a pathway to bridge the gap between intuition and logic in physical-science invention.

Introduction

The authors challenge the reductionist view that scientific discovery is merely the combination of induction (data compression) and deduction (formal theorem proving), using Einstein's creation of General Relativity as a computational case study. Prior work in AI-driven discovery has shown success in extracting patterns from data or verifying theories from given axioms, but it cannot explain how novel axioms are formulated when no error signal or large dataset exists. The authors argue that the critical missing ingredient is abduction—the creative inference of a cause to explain a surprising phenomenon—and demonstrate that Einstein's axiomatic leap was driven by embodied thought experiments, not by statistical gradient. They conclude that current large language models, which lack physically consistent world models, are structurally incapable of the abductive jump required for true scientific invention, and propose that future AI must integrate sensory simulation to ground abstract symbols in physical experience.

Method

The authors propose a conceptual framework for automating scientific discovery that bridges the gap between logical deduction and the generation of novel axioms. They argue that while modern AI systems excel at deduction, which involves deriving theorems from existing axioms, they lack the capacity for the abductive jump required to formulate new foundational principles. To address this, the authors introduce the concept of Manipulative Abduction, a cognitive process relying on embodied simulation to generate hypotheses through active interaction with mental models.

This thought process is conceptualized as a two-stage mechanism. The first stage involves Simulation as Physical Variation, which can be viewed through the lens of Test Time Reinforcement Learning. In this phase, the system invents new variations of a problem to force progress. Unlike symbolic variations bounded by fixed rules, this requires manipulating perceptual experience to invent new axioms based on physical intuition.

As illustrated in the figure above, the equivalence principle thought experiment exemplifies this stage. By simulating the physical sensations of an observer inside a sealed environment, such as comparing a stationary elevator in a gravitational field to an accelerating elevator in deep space, the system generates a specific sensory pattern. The second stage is Abduction and the Physical Prior, where the system performs abductive reasoning to infer the best explanation for the simulated observation. Because the simulated sensory experience of acceleration is indistinguishable from the remembered sensory experience of gravity, the system abducts that they must be the same phenomenon, effectively pruning the search space of possible axioms using a physical prior.

To operationalize this in AI, the authors point to the emergence of interactive World Models. Unlike passive video generators that rely on statistical correlation, architectures like Genie introduce action controllability, allowing for agentic intervention. This capability is a prerequisite for Manipulative Abduction, as it enables the AI to perform counterfactual interventions, such as conceptually cutting the cable of an elevator, rather than merely observing. By operating on a consistent latent physics manifold, these interactive environments provide a synthetic laboratory to transform the abductive jump from a mystical insight into a reproducible algorithmic process.


AIでAIを構築

アイデアからローンチまで — 無料のAIコーディング支援、すぐに使える環境、最高のGPU価格でAI開発を加速。

AI コーディング補助
すぐに使える GPU
最適な料金体系

HyperAI Newsletters

最新情報を購読する
北京時間 毎週月曜日の午前9時 に、その週の最新情報をメールでお届けします
メール配信サービスは MailChimp によって提供されています