T
ToolMesh
V

Vecy: On-device AI & LLM APP for RAG

Free
3.9
92 Reviews•android

Vecy is an Android AI app that enables private LLM chats using local files through RAG. It automatically processes and indexes documents, photos, and other files, allowing users to interact with their data securely. With support for multiple LLM sizes and offline functionality, it enhances response accuracy by leveraging embedding vectors generated from local content.

Document ProcessingWriting & Text ToolsNoCode & Automation

What is Vecy: On-device AI & LLM APP for RAG?

Vecy is an Android AI app that allows users to chat with fully-private LLMs and local files (documents, photos). It automatically processes and indexes local files on the phone, and users can also directly upload files. Vecy offers RAG tools for processing local files to enhance LLM responses. Users can select from a range of small LLMs (from 0.5B to 3.5B parameters) and engage in conversations with documents stored locally. The app automatically processes files (PDFs, DOCX documents, images, etc.) within the Documents, Download, and DCIM directories to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.

Core Technologies

AI ChatbotNatural Language ProcessingData IntegrationRAG (Retrieval-Augmented Generation)

Use Cases

  • Chat with local documents and images using a private LLM
  • Enhance LLM responses with embedded file data
  • Search and retrieve information from local files
  • Converse with documents stored on your device
  • Use image search features for visual data retrieval

Our Benefits

  • Fully private LLM conversations
  • Automatic file processing and indexing
  • RAG capabilities for accurate responses
  • Offline functionality
  • Image search

Key Features

  • Chat with fully-private LLMs
  • Process and index local files automatically
  • Direct file upload
  • RAG tools for enhanced LLM responses
  • Image search

How to Use

1

Install the Vecy app on your Android device.

2

The app automatically processes files in the Documents, Download, and DCIM directories.

3

You can also upload files directly.

4

Select an LLM and start chatting with your local files.

Pros & Cons

Pros

  • Fully private LLM conversations
  • Automatic file processing and indexing
  • RAG capabilities for accurate responses
  • Offline functionality
  • Image search

Cons

  • Limited to Android devices
  • LLM size limited to 3.5B parameters
  • Data safety practices may vary

Frequently Asked Questions

What types of files does Vecy support?

Vecy supports PDFs, DOCX documents, images, and other file types commonly found in the Documents, Download, and DCIM directories.

Where are the embedding vectors stored?

The embedding vectors are stored locally on the device.

What is RAG and how does Vecy use it?

RAG (retrieval-augmented generation) enhances the LLM's ability to provide more accurate and relevant responses when queries are related to local files. Vecy uses embedding vectors generated from local files to enable RAG.

Contents