LLM Test Server

About LLM Test Server

LLM Test Server is a local, deterministic stand-in for 13 LLM provider APIs. Your app keeps its official SDK and points it at namespaced routes like /openai/v1; answers, tool calls, streams and failures come from fixtures your test sets up. The dashboard shows where every token goes: system prompt, tool schemas, conversation turns, prompt-cache reads and writes. Built forNET and Aspire, and shipped as a Docker image so any stack can use it. Free and open source.

The person behind LLM Test Server

• 
  Alina Kostiuk 🇺🇦

  Maker

  COO at Prostir

  Email not found yet