Neura Market
IntelliServer logo

IntelliServer

Free

simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

FreeFree tier
Type
Open Source
Visit Website GitHub (38 stars)

About IntelliServer

IntelliServer is an open-source microservice that provides unified access to multiple AI models, enabling developers to integrate AI capabilities into their projects with a single API. It supports chatbot functionalities using ChatGPT, Llama, AWS Sagemaker and other models, LLM evaluation for comparing model performance, semantic search across text documents, image generation using diffusion models, chat context retrieval, document parsing (PDF, Word), and OCR via AWS or Google Vision. Built on a microservices architecture, it can be deployed via Docker or npm, allowing scalable and private AI middleware. The tool simplifies model evaluation and switching, making it suitable for research and production environments.

Key Features

Chatbot functionality using ChatGPT, Llama, AWS Sagemaker, and more
LLM evaluation to compare model performance
Semantic search across text documents
Image generation using diffusion image models
Chat context retrieval for relevant messages
Document parsing (PDF, Word) to text
OCR from images using AWS or Google Vision
Unified API for multiple AI models with same endpoint format
Microservices architecture for scalable, independent deployment
Docker containerization and npm installation

Pros & Cons

Pros
  • Open-source and free to use
  • Unified API access to multiple AI models simplifies integration
  • Microservices architecture enables scalable, independent deployment
  • Supports a wide range of AI capabilities: chat, search, images, OCR, parsing
  • Containerized deployment via Docker for easy setup and portability
  • Provides model evaluation feature to compare performance data-driven
  • Self-hosted, ensuring data privacy and control
Cons
  • Requires self-hosting and setup (Docker, npm, environment variables)
  • Needs API keys for each integrated model (e.g., OpenAI, Cohere, Stability)
  • Dependency on external services for OCR (AWS, Google) may incur costs
  • Relatively small community and limited documentation beyond GitHub repo
  • May require technical expertise to configure and customize

Best For

Building AI-powered chatbots and conversational agentsEvaluating and comparing different LLMs for optimal model selectionImplementing semantic search in document repositories or knowledge basesGenerating images from text descriptions for content creationExtracting text from PDFs, Word documents, and imagesIntegrating AI capabilities into existing applications via a unified APIRapid prototyping and testing of AI models in microservice architecture

FAQ

How do I install IntelliServer?
IntelliServer can be installed via npm (npm install, npm start) or Docker (docker build/run). See the GitHub repository for detailed instructions.
How do I protect my server endpoints?
Set the API_KEY and ADMIN_KEY environment variables when starting the container or in a .env file. Clients must include the API key in their requests.
What models are supported?
IntelliServer supports ChatGPT, Cohere, Llama, Stability, Hugging Face inference, AWS Sagemaker, and more. You can add your own model keys via environment variables.
How can I test the endpoints?
You can use the Swagger interactive docs at localhost/api-docs/ or import the Postman collection from the repository's postman folder.