Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning

Apple ML Research··

Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments. By generating intermediate reasoning images, Visual CoT provides an intuitive mechanism for visual foresight but introduces substantial inference overhead, which is particularly problematic for proactive video reasoning. We ask whether models can learn to think visually during training while reasoning directly at inference. We introduce Internalized...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 3mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 3mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 3mo ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 3mo ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 3mo ago