Sign in Join

Live chat for Free Pascal, Lazarus, Delphi and every Pascal programmer.

Catalog · How the catalog works

Random project

fpc-llama

Freepascal bindings for Llama.cpp

View on GitHub

Anyone may press Interesting, signed in or not. It helps others find this project.

Member rating

No ratings yet.

Sign in to rate this project.

README

fpc-llama.cpp

Freepascal bindings for Llama.cpp

Derived from https://github.com/Kagamma/llama-pass but updated to work with llama.cpp, commit 82e4f64578dc3db40185e6b91195e73c9e995952 Tue Dec 12 20:04:10 2023 +0100

Also provided is llama-cli, an example application to do basic inference of gguf models. Build it with:

pascal
lazbuild llama_cli.lpi

For a complete GUI application using Llama.cpp and fpc-llama, see Neurochat at https://github.com/ortegaalfredo/neurochat

Tested with fpc 3.2.2, Lazarus 3.0.0.