llama-cpp-delphi
- Active
- Library
- Delphi
- GitHub
- ★ 56

30,060 projects in the catalog.
Free Pascal, Lazarus and Delphi components, libraries and programs from GitHub, SourceForge, Codeberg, GitLab and more. Rate them, mark what looks interesting, and talk about them on their benches.
Free Pascal bindings for llama.cpp
Freepascal bindings for Llama.cpp
Delphi wrappers and compiled Windows DLLs for local LLM inference and embeddings via llama.cpp
Delphi 11+ bindings for llama.cpp (b11900+) with full GPU acceleration. Updated from the original Embarcadero fork: new memory API, vocab object, backend loader, CUDA 13, RTX 30xx/40xx/50xx support, Flash Attention, quantized KV cache, Jinja2 chat templates, and multimodal vision inference via the mtmd API.
VindexLLM is a pure Delphi, GPU-powered LLM inference engine that uses Vulkan compute shaders to run GGUF models entirely on the GPU. It performs full transformer inference without relying on Python, CUDA, or other external runtimes, requiring only vulkan-1.dll, which is typically included with modern GPU drivers.
The AI Operating System for Delphi. 100% native framework with RAG 2.0, autonomous agents, MCP protocol, and universal LLM connector. Supports OpenAI, Claude, Gemini, Ollama, and more. Delphi 10.4+ (limited), full support from Delphi 12 Athens.
PasLLM - LLM inference engine in Object Pascal (synced from my private work repository)
Ultra-lightweight native AI agent framework written entirely in Object Pascal for Delphi and Free Pascal, designed for performance, portability, and extensibility.
MCP (Model Context Protocol) server library for Delphi. Built on DMVCFramework, it lets you expose tools, resources and prompts via attributes and RTTI. Supports both HTTP Streamable and stdio transports. MCP 2025-03-26 compliant.
LLM inference in Delphi
Lazarus component for CHATGPT
mORMot2-based AI/LLM extension for Free Pascal and Delphi: MCP server, LLM clients, embeddings, vector stores, RAG
High performant CUDA powered LLM inference library
GPT Transformer developed in Delphi 13
An easy to use, high performant CUDA powered LLM inference library.
LlamaCPP library for Object Pascal Notebook
Short term long term AI agent memory system using fine-tuning, priors, and RAG.