oMLX
Native macOS LLM server on MLX with SSD KV caching for fast local agent responses
oMLX is a native macOS inference server built on Apple's MLX. Paged SSD KV caching and continuous batching cut the time to first token for agents from 30 to 90 seconds to under 5 seconds, according to the site. It offers OpenAI- and Anthropic-compatible APIs for Claude Code, OpenClaw, and Cursor, needs Apple Silicon and macOS 15, and uses the Apache 2.0 license.
Use it to run local models for coding agents on a Mac. Check that your Mac has enough memory for the model you choose.
Why it is here. It makes local models practical for agent workloads on a Mac.
- MLX-based
- SSD KV cache
- OpenAI and Anthropic APIs
Verified 2026-10-09. HTTP 200. https://omlx.ai/ (HTTP 200, page fetched 2026-10-09), https://github.com/jundot/omlx (GitHub API, 22643 stars), depo.zip listing https://www.depo.zip/tools/j575z8fwvd79vppz2k6s83k7n585f57f
