Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents

Apple ML Research··

Multimodal agents commonly generate freeform reasoning before each action. For small models, limited model capacity can result in lengthy reasoning that provides little useful guidance for action generation while incurring substantial inference cost. To address this challenge, we introduce Selection-based Structured Reasoning (SSR), a framework that reformulates reasoning as selection instead of open-ended generation. SSR represents recurring high-level reasoning as pre-specified, reusable natur...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 5mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 5mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 5mo ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 5mo ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 5mo ago