PyQt6 based Llama.cpp (llama-server) Tray Manager for Linux (Arch Linux / CachyOS).
✨ Features
- Effortless Server Management: Start/stop
llama-serverwith a single click - Zombie Process Prevention: Automatic cleanup on close or crash
- Real-Time Monitoring: CPU, RAM, GPU, VRAM tracking (1s refresh)
- Profile Management: Save/load/delete named configurations
- Advanced Configuration: GPU layers, context size, port, extra params
- Web UI Integration: One-click to open llama.cpp web interface
- Persistent Settings: Auto-saved to
~/.llamatray/ - GPU Agnostic: NVIDIA (pynvml), AMD (rocm-smi), integrated GPUs
- Native Linux: Wayland & KDE Plasma support
📦 Arch Linux Package
sudo pacman -U llamatray-1.0.0-1-any.pkg.tar.zst
LlamaTray