Voyage Multimodal-3 logo

Voyage Multimodal-3

Free

Mixed text-image documents

FreeFree tier
Inputs: text, image, video
Type
Open Source
Company
Voyage AI

About Voyage Multimodal-3

Voyage AI's multimodal embedding models transform unstructured data from multiple modalities into a shared vector space. Unlike traditional models like CLIP, which process text and images separately, Voyage's models use a single backbone to directly vectorize inputs containing interleaved text and images. This eliminates the need for complex text extraction or ETL pipelines and removes modality bias in mixed-modality searches. The models support rich visual data such as PDF screenshots, slide decks, tables, figures, photos, and videos (video support via voyage-multimodal-3.5). They offer a context length of 32,000 tokens and various embedding dimensions (default 1024, with options 256, 512, 2048). Voyage multimodal embeddings are accessible through a Python API via the voyageai package, with usage-based pricing and a generous free tier (first 200M text tokens and 150B pixels free).

Key Features

Directly vectorizes interleaved text and images without separate extraction
Single backbone architecture eliminates modality bias (unlike CLIP)
Supports content-rich visual data: PDFs, slides, tables, figures, photos, videos
32,000 token context length with configurable embedding dimensions (256, 512, 1024, 2048)
Python API via voyageai package with support for Pillow images and video objects
Generous free tier: 200M text tokens and 150B pixels free per account
Usage-based pricing with per-token and per-pixel rates
Handles up to 1,000 inputs per request, with image size limits (max 16 MP or 20 MB)

Pros & Cons

Pros
  • Eliminates need for complex text extraction pipelines and OCR
  • Processes interleaved text and images in one call without separate encoders
  • No modality bias – better retrieval relevance than CLIP for mixed data
  • Large context window (32K tokens) for long documents
  • Free tier generous enough for many applications
  • Flexible embedding dimensions for different use cases
Cons
  • API-based – not available for on-premise/local inference
  • Pricing can accumulate for high volumes after free tier limits
  • Video support only available in voyage-multimodal-3.5, not voyage-multimodal-3
  • Image constraints: max 16 million pixels or 20 MB per image
  • Dependency on third-party libraries (Pillow) for image handling
  • Requires internet connectivity and API key for access

Best For

Mixed-modality semantic search across text and imagesAI agents that need to understand documents with embedded figures and tablesRAG (Retrieval-Augmented Generation) systems with multimodal contentDocument understanding and analysis (PDFs, slides, screenshots)Image and video content retrieval and clusteringVideo frame analysis (via voyage-multimodal-3.5)