LocalAI
The free, Open Source alternative to OpenAI
What is LocalAI?
LocalAI is the free, Open Source alternative to OpenAI. It's a self-hosted, community-driven, local-first AI platform for running LLMs, generating images, audio, and more.
Key Features
- OpenAI API compatible
- No GPU required (CPU inference)
- Text generation with various models
- Image generation
- Audio transcription
- Embeddings
- Function calling
Deployment on Moltern
LocalAI can be deployed on Moltern with a single click. Moltern handles:
- Automatic SSL/TLS certificates via Let's Encrypt
- Persistent storage for your data
- Environment configuration through the dashboard
- Container orchestration with automatic restarts
Getting Started
- Navigate to the Services page in Moltern
- Search for "LocalAI"
- Click Deploy and configure your settings
- Access your instance via the provided URL