ForkFree

AI models and chat

mlx-serve

by ddalcu

A native Mac app and local server that runs open AI models on Apple Silicon without Python. It offers chat, coding agents, image, video, music and speech generation, and speaks the OpenAI, Anthropic and Ollama APIs.

Proof level: ReadWorth a lookMIT

Get it on GitHubProject websiteCompare

No demo yet

Proof level: Read. We read its README and licence and ran our automatic checks. We have not run it yet. So this page is based on its README and our automatic checks.

The catch

Worth a lookEstablished, with a few things to check (listed below).

Check this first: Needs a recent Mac (macOS 26.2+, Apple Silicon); larger models need a lot of memory.

Things to check

  • Needs a recent Mac (macOS 26.2+, Apple Silicon); larger models need a lot of memory
  • Licence is not detected automatically, though the README says MIT
  • Some media models may carry their own licences

Can you use mlx-serve commercially?

Free to use, change and sell (MIT-style terms in the licence file). Some folders may carry other terms.

Not legal advice. Read the project's licence file before building a product on it.

What can you do with mlx-serve?

  • Run open chat models locally and point OpenAI, Anthropic or Ollama clients at the local server
  • Launch Claude Code or other coding agents against a model running on your own Mac
  • Generate images, video, music and cloned-voice speech, or transcribe meetings, all offline

How do you get mlx-serve running?

Download the DMG and drag it to Applications, or install with Homebrew; it needs macOS 26.2 or later on Apple Silicon.

Follow the official instructions in the project README.

Make money with it

Offer private, on-device AI setups, transcription or voice and image content creation to clients who cannot use cloud services.

An idea, not financial advice. Check the licence before charging for anything built on it.

Ways a business could use it

  • Run private AI chat and document assistance on company data without sending it to a paid cloud service
  • Cut API costs by pointing existing OpenAI-compatible tools and coding agents at a local model

Who's talking about it

Checked 08 Nov 2026. Summary drafted by AI from the project's README. Proof level 1 of 4, Read: we read its readme and licence and ran our automatic checks. we have not run it yet.

Similar tools in AI models and chat

dsh-our-free-model Ebony-Vinyl
New and promising

This tool provides access to free AI models, including DeepSeek V4.1 Flash and Kimi K3, without requiring login or API keys. It integrates with DSH and offers features like model selection, usage tracking, and local gateway support.

Instead of Anthropic, LobsterAI

Proof level: Read 81.5k stars +1471 a day MIT
magpie yetone
New and promising

magpie is a tool that allows you to switch between different AI models and agents from one local gateway, making it easier to manage multiple AI services.

Instead of Claude, ChatGPT

Proof level: Read 30.8k stars +755 a day MIT
Strata Niko1221
New and promising

Strata is an AI inference engine that allows users to run powerful AI models on their own computer, including chat, coding, and image processing capabilities.

Proof level: Read 41.3k stars +639 a day MIT