ForkFree

AI models and chat

Soup

by MakazhanAlpamys

Soup is a command-line tool that fine-tunes large language models from a single YAML config file. It can train on modest hardware, including an 8B model on a 4 GB laptop GPU using layer streaming.

Proof level: ReadWorth a lookApache-2.0

Get it on GitHubProject websiteCompare

No demo yet

Proof level: Read. We read its README and licence and ran our automatic checks. We have not run it yet. So this page is based on its README and our automatic checks.

The catch

Worth a lookEstablished, with a few things to check (listed below).

Check this first: Layer streaming is still labelled beta.

Things to check

  • Layer streaming is still labelled beta
  • Fast release pace, with recent versions adding rules that can refuse previously accepted configs
  • Needs a GPU (or Apple Silicon) and some machine learning knowledge to get good results

Can you use Soup commercially?

Free to use, change and sell, including in paid products. Keep the copyright notice.

Not legal advice. Read the project's licence file before building a product on it.

What can you do with Soup?

  • Fine-tune an open language model on your own data using LoRA or QLoRA from one YAML file
  • Check whether a model will fit on your GPU before training using the profile command
  • Train on preference data with methods such as DPO, ORPO and SimPO, including on Apple Silicon

How do you get Soup running?

Install with pip using "pip install soup-cli[train]", then run "soup init" and "soup train" with a suitable GPU and drivers set up.

Follow the official instructions in the project README.

Make money with it

A freelancer could offer paid fine-tuning of small open models on clients' own data, using a consumer GPU rather than cloud hardware.

An idea, not financial advice. Check the licence before charging for anything built on it.

Ways a business could use it

  • Train a small custom model on your own support or product data so you can run it locally instead of paying per-token API fees
  • Build tailored chat or writing models for clients as a fine-tuning service without renting expensive cloud GPUs

Who's talking about it

Checked 08 Nov 2026. Summary drafted by AI from the project's README. Proof level 1 of 4, Read: we read its readme and licence and ran our automatic checks. we have not run it yet.

Similar tools in AI models and chat

dsh-our-free-model Ebony-Vinyl
New and promising

This tool provides access to free AI models, including DeepSeek V4.1 Flash and Kimi K3, without requiring login or API keys. It integrates with DSH and offers features like model selection, usage tracking, and local gateway support.

Instead of Anthropic, LobsterAI

Proof level: Read 81.5k stars +1471 a day MIT
magpie yetone
New and promising

magpie is a tool that allows you to switch between different AI models and agents from one local gateway, making it easier to manage multiple AI services.

Instead of Claude, ChatGPT

Proof level: Read 30.8k stars +755 a day MIT
Strata Niko1221
New and promising

Strata is an AI inference engine that allows users to run powerful AI models on their own computer, including chat, coding, and image processing capabilities.

Proof level: Read 41.3k stars +639 a day MIT