llama.cpp

LLM inference in C/C++. Run LLaMA, Mistral, Gemma models efficiently on CPU.

Install

git clone https://github.com/ggml-ai/llama.cpp

Always review the official documentation before installing.

Large-scale AI training framework. Parallel training, fine-tuning, and inference of LLMs.

Build and share machine learning demos and web apps in Python. Create interactive model interfaces with a few lines of code.

Official Anthropic plugins for Claude Code. Frontend design, feature dev, security review, testing.