Yujian Tang - LLM Stack Market Map - March 2025
FreeLLM Stack Market Map – March 2025
FreeFree tier
About Yujian Tang - LLM Stack Market Map - March 2025
Yujian Tang's LLM Stack Market Map for March 2025 is a community-driven categorization of the AI infrastructure landscape. It organizes companies and tools into key segments: Inference (e.g., Anthropic, OpenAI, Fireworks AI), Observability (e.g., Arize AI, Galileo, Comet), Frameworks (e.g., LangChain, LlamaIndex, Boundary), Retrieval (replacing vector databases), and Data Management (ETL/ELT for LLM data). The map also proposes a new category for Agent Builders and Agents, inviting feedback via LinkedIn.
Key Features
Categorizes the LLM stack into Inference, Observability, Frameworks, Retrieval, Data Management, and Agent Builder proposals
Lists prominent companies in each category (e.g., Anthropic, LangChain, Arize AI)
Community-contributed feedback and suggestions via LinkedIn comments
Regular updates (planned April 2025 refresh)
Free and open-source market map shared on LinkedIn
Pros & Cons
Pros
- Comprehensive overview of key LLM infrastructure categories from an industry expert
- Community input enriches the map with additional tools (e.g., Predibase, TitanML, Gooey.AI)
- Free and publicly accessible on LinkedIn
- Regularly updated to reflect rapid market changes
Cons
- Categories are subjective and may overlap (e.g., Orchestration vs. Frameworks debate)
- Not exhaustive; relies on community suggestions to fill gaps
- Primarily a single-author perspective with limited formal methodology
Best For
Understanding the AI infrastructure ecosystem for LLM deploymentIdentifying vendors for inference, observability, and data managementMarket research and competitive analysis in the LLM stack spaceGuiding technology selection for building LLM applications
FAQ
What categories does the LLM Stack Market Map include?
The March 2025 version includes Inference, Observability, Frameworks, Retrieval, and Data Management, with a proposed new category for Agent Builders/Agents.
How can I contribute or suggest additions?
You can comment on the LinkedIn post with your suggestions. Several commenters have already recommended tools like Predibase, TitanML, and Gooey.AI.
Is the market map regularly updated?
Yes, the author indicated an update planned for April 2025 after the Seattle Startup Summit.
Who created this market map?
Yujian Tang, a LinkedIn user who shares regular industry analyses, created the map.