Sign in Join

Live chat for Free Pascal, Lazarus, Delphi and every Pascal programmer.

Catalog · How the catalog works
Anything · Lazarus or Delphi
Random projectRandom project

LlamaControlCenter

View on GitHub

Member rating

No ratings yet.

Sign in to rate this project.

README

Llama Control Center 🦙💻

Llama Control Center is a local AI management suite and modern Graphical User Interface (GUI) for llama.cpp, built with Free Pascal and Lazarus LCL. It is designed to streamline managing GGUF models, running inference servers, monitoring hardware, and benchmarking performance locally.

image

🚀 Key Features

  • Server Control & Real-Time Telemetry: Manage the inference engine (llama-server) with full control (Start, Stop, Restart), real-time PID monitoring, and uptime tracking.
  • Hardware Telemetry: Monitor live hardware resource usage, including CPU, System RAM, and GPU VRAM utilization.
  • Model Hub (GGUF Browser): Explore and inspect in-depth GGUF metadata, including model architecture, parameter count, quantization type, and file size.
  • AI Playground: Interactive chat interface with streaming support for instant model testing.
  • Performance & Inference Benchmark: Integrated llama-bench to evaluate Prompt Processing (PP) and Text Generation (TG) speeds, complete with CSV export support.
  • Model Downloader & Quantizer Studio: Unified utility to download models and manage quantization workflows.
  • System Tray & Config Management: Supports minimize-to-tray and automated JSON-based configuration management with a Smart Path Resolver.

🛠️ Tech Stack

  • Programming Language: Object Pascal (Free Pascal)
  • GUI Framework: Lazarus Component Library (LCL)
  • Backend Engine: llama.cpp (llama-server, llama-bench)

⚙️ System Requirements & Installation

  1. Operating System: Windows (x64)
  2. Supporting Binaries: Ensure llama-server.exe and llama-bench.exe are placed in the application's binary directory (e.g., bin/engine/) or configured via the settings menu.
  3. Lazarus IDE (optional, for development):
    • Latest version of Lazarus with a Free Pascal compiler supporting objfpc mode.

Download

Download Binary => https://github.com/CodeInPas/LlamaControlCenter/releases/

☕ Support the Project

If you find LLAMA Control Center helpful and want to support its ongoing development, consider buying me a coffee or sending a tip. Any support is deeply appreciated!

💡 Your support keeps the momentum going!
Every contribution directly fuels my passion, energy, and motivation to continuously build, maintain, and release even more useful open-source desktop applications for the developer community.