PrivateGPT
Interact with your documents using the power of LLMs, 100% privately
What is PrivateGPT?
PrivateGPT is a production-ready AI project that allows you to ask questions to your documents using Large Language Models (LLMs), even in a completely offline environment.
Key Features
- 100% private document Q&A
- Offline capable
- Multiple LLM support
- RAG architecture
- Document ingestion
- API and UI
- GPU and CPU support
Deployment on Moltern
PrivateGPT can be deployed on Moltern with a single click. Moltern handles:
- Automatic SSL/TLS certificates via Let's Encrypt
- Persistent storage for your data
- Environment configuration through the dashboard
- Container orchestration with automatic restarts
Getting Started
- Navigate to the Services page in Moltern
- Search for "PrivateGPT"
- Click Deploy and configure your settings
- Access your instance via the provided URL