Web UI
Open Models from the bottom of the sidebar. The page shows:- Total visible models
- Downloaded and loaded counts
- Total local model storage used
- Provider-grouped model cards
- Search, status filters, and category filters
| Filter | Meaning |
|---|---|
| All | Show every enabled catalog model. |
| Loaded | Show models with ready status. |
| Downloaded | Show models downloaded to disk but not loaded. |
| Not downloaded | Show models available for download. |
- Text to Speech
- Transcription
- Chat
Model Statuses
| Status | Meaning | Typical action |
|---|---|---|
not_downloaded | Available in the catalog, not on disk | Download |
downloading | Download in progress | Wait or cancel |
downloaded | Files are on disk, model is not in memory | Load or delete |
loading | Runtime is loading the model | Wait |
ready | Model is loaded and available for inference | Use or unload |
error | Download/load failed | Refresh, retry, or inspect logs |
Actions
| Action | Where | Notes |
|---|---|---|
| Refresh | Models page header | Re-reads catalog and local status. |
| Download | Model card | Downloads model files into the configured models directory. |
| Cancel | Downloading model card | Cancels an active download when the runtime supports cancellation. |
| Load | Downloaded model card | Loads the model into memory. |
| Unload | Ready model card | Frees runtime memory while keeping files on disk. |
| Delete | Downloaded or ready model card | Removes local model files after confirmation. |
CLI
API
Model management routes live under/v1/admin/models:
| Route | Purpose |
|---|---|
GET /v1/admin/models | List model catalog and local status. |
POST /v1/admin/models/{variant}/download | Start a download. |
GET /v1/admin/models/{variant}/download/progress | Read download progress. |
POST /v1/admin/models/{variant}/download/cancel | Cancel a download. |
POST /v1/admin/models/{variant}/load | Load into memory. |
POST /v1/admin/models/{variant}/unload | Unload from memory. |
DELETE /v1/admin/models/{variant} | Delete local files. |