LM Studio

Rare card · No. 66805

LM Studio is large language model inference software for running and using large language models locally on personal computers. It provides tools for downloading and managing models, interacting with them through a chatbot interface, and serving locally running models to other applications through an application programming interface (API). LM Studio uses llama.cpp as an inference engine for models in the GGUF format and also supports Apple's MLX framework on Apple silicon. In addition to its graphical interface, the platform includes command-line tools, software development kits for Python and TypeScript, and a local inference server with native, OpenAI-compatible, and Anthropic-compatible APIs.

Read on Wikipedia