oMLX

oMLX

Mac LLM server that cuts agent wait times from 90s to 5s

Product HuntOpen SourceLaunched Aug 30, 202699#14 of the day

About oMLX

oMLX turns your Mac into a full LLM inference server, run from the menu bar. It serves text, vision, OCR, embedding and reranker models with continuous batching, plus a RAM+SSD tiered KV cache that survives restarts, so Claude Code and Cursor respond in about 5s instead of 90s. OpenAI and Anthropic compatible APIs drop straight in. Native Swift, not Electron. Apache 2.0, open source.

The people behind oMLX

We haven't found the people behind oMLX yet. New makers are added as we find them.

More Open Source launches

Made oMLX? Ask us to remove this listing or your details.