On-Device Privacy
Run LLM models directly on device for privacy and offline capabilities π€
On-Device Privacy
Run LLM models directly on device for privacy and offline capabilities π€
Apple Intelligence
Native Apple Intelligence integration on iOS 18.0+ π
Multiple Formats
Support for .gguf, .task, and .litertlm model formats π¦
Hardware Acceleration
Fast inference with native hardware acceleration β‘
Streaming Responses
Real-time streaming responses with event listeners π
Getting Started
Check the Getting Started Guide to install and configure the plugin.