Vecy: On-device AI & LLM APP for RAG

Vecy is an Android AI app that allows users to chat with fully-private LLMs and local files (documents, photos). It automatically processes and indexes local files on the phone, and users can also directly upload files. Vecy offers RAG tools for processing local files to enhance LLM responses. Users can select from a range of small LLMs (from 0.5B to 3.5B parameters) and engage in conversations with documents stored locally. The app automatically processes files (PDFs, DOCX documents, images, etc.) within the Documents, Download, and DCIM directories to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.

How to Use

Install the Vecy app on your Android device. The app automatically processes files in the Documents, Download, and DCIM directories. You can also upload files directly. Select an LLM and start chatting with your local files.

Key Features

• Chat with fully-private LLMs
• Process and index local files automatically
• Direct file upload
• RAG tools for enhanced LLM responses
• Image search

Use Cases

• Chatting with local documents and images using a private LLM.

FAQ

What is RAG and how does Vecy use it? NoFilterGPT Unfiltered, uncensored, anonymous AI chat service with absolute privacy.