prompt
FreeSustained multimodal search agent with horizon up to 100 turns
About prompt
The Long-Horizon Multimodal Search Agent is an advanced system prompt designed for AI agents to perform sustained, multi-turn visual and textual searches across up to 100 search steps. It implements file-based visual context management, progressive on-demand image loading, and search trajectory planning to avoid common failure modes such as context bloat, visual memory loss, redundant re-search, hallucinated visual claims, and horizon collapse. The prompt structures the agent's reasoning into core responsibilities including maintaining a visual index with UID references, loading images only when required, batching visual requests, and conducting horizon reviews every 10 turns to re-plan based on evidence gathered. It supports multi-hop visual reasoning with three hops: locating candidate sources, extracting visual evidence, and synthesizing findings. The agent is tested on benchmarks like MM-BrowseComp and MMSearch-Plus, and scales to 100-turn search horizons.
Key Features
Pros & Cons
- Eliminates context bloat by offloading full-resolution images and keeping only UID references and compressed summaries
- Prevents visual memory loss with a persistent visual index and horizon review mechanism
- Avoids redundant re-search through structured search trajectory planning
- Reduces hallucination by only describing images that were actually loaded and recorded
- Scales to 100-turn search horizons without horizon collapse
- Achieves state-of-the-art results on multimodal search benchmarks
- Requires a system capable of managing file-based visual context and executing complex trajectory planning
- May have higher upfront planning overhead due to search tree drafting and horizon reviews
- Dependent on the underlying model's ability to follow a multi-step structured prompt accurately
- Performance may degrade if the model fails to adhere to the indexing and loading rules