Llama.cpp
Open-source software library for LLM inference
Llama.cpp
llama.cpp is an open-source software library that performs inference on various large language models such as Meta's Llama model. It is co-developed alongside the GGML project, a general-purpose tensor library. Command-line tools are included with the library, alongside a server with a simple web interface. llama.cpp has been considered as the de facto standard as the core of almost all local inference tools, including Ollama and LM Studio.
Read on Wikipedia · Image The ggml authors, MIT
Open boosters, collect cards and trade them. Free to play.
Play for free