Preprint2024
OmniParser
Unknown
OmniParser converts UI screenshots into structured elements, boosting GPT-4V's ability to interact accurately with interfaces.
0Aug 1, 2024
arXiv
AI Research
AI & ML Research Papers
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
All Papers
4 papersPreprint2023
GPT-4V
Unknown
GPT-4V is a multimodal model that integrates text and vision capabilities for analyzing image inputs.
0Sep 1, 2023MultimodalComputer Vision
Preprint2024
Papers Explained 187c: Llama 3.1 — Multimodal Experiments
Unknown
Llama 3.1 adds multimodal capabilities via compositional cross-attention adapters for vision and speech, achieving competitive performance with GPT-4V and strong video reasoning.
0Jul 1, 2024Multimodal
Preprint2024
The application of multimodal large language models in medicine
Unknown
This paper explores the application of multimodal large language models, specifically GPT-4V, in medicine, connecting LLMs with vision input for clinical tasks.
0Jan 1, 2024Large Language ModelsMultimodal