llama.cpp

Xencode — Runs a terminal coding assistant that talks to local or cloud models and edits a workspace with approval checkpoints.

Xtream Agentic Harness — Runs a terminal AI assistant that keeps tool outputs out of long-term chat history, uses XML-based tool calling that works across models, and archives each turn for restoring.

Summon — Provisions disposable cloud GPU workers on demand, attaches a cached model, runs inference, and destroys the worker afterward.

Orihai — Runs long-form interactive fiction over weeks, keeping characters, locations and facts consistent by compiling each turn into a budgeted context.

Crucible — Runs a terminal AI agent harness that lets local LLMs call a built-in constraint solver and rewind file and conversation state via git checkpoints.

Have AI API keys / self-hosted… — Lets users chat with multiple cloud and self-hosted LLMs on iOS using their own API keys, with MCP connectors, RAG memory, and parameter controls.

Otaku — Runs LLM-powered roleplay chats with automatic summarization, character extraction, and transparent context building, through a web UI or terminal UI.

Warren — Captures pages you read in Chrome and builds a local, searchable markdown wiki of them using a local vision model.

Living Web: AI Assistant & Content Summarizer — Runs local or cloud LLMs in a browser sidebar to summarize pages, chat with documents, explain or translate text, and automate basic form filling and table exports.

I shipped my first… — Generates invoices with an AI assistant that runs locally on the user's machine.

warpdrv — Runs local LLMs through a desktop harness with built-in tools, sub-agents, voice chat, and a second AI that reviews outputs.

Kallilex — Corrects, shortens, or rephrases selected text via a global hotkey and inserts the result back in place using any configurable AI endpoint.

Musiclyse — Analyzes a song's audio with multiple models and lets a local LLM discuss and compare tracks with the user in a terminal chat.

Otaku — Runs a terminal roleplay chat client for LLMs that shows the exact context sent, auto-summarizes older messages, and extracts characters from chats.

LLMs Gateway — Turns a local machine into an OpenAI-compatible endpoint that installs and serves GGUF models from Hugging Face in per-capability llama.cpp containers.

local-llmup — Installs and switches local LLM models across runtimes such as Ollama, llama.cpp, MLX, and LM Studio.

LlamaForge — Provides a graphical control panel for launching and managing llama.cpp and vLLM local model servers and setting up agents.

I built a GUI control panel for… — Provides a graphical control panel for configuring and launching llama-server with llama.cpp model settings.

claudely — Launches Claude Code against local LLM servers like LM Studio, Ollama, and llama.cpp without modifying the user's real Claude config.

v7multiplikator — Runs transformer language model inference directly on the CPU using hand-written x64 assembly with AVX2 kernels.