Soup

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done. Maintained by MakazhanAlpamys on GitHub, where it has earned 75 stars from the community.

It's actively developed around artificial-intelligence, cli, dpo, and is a solid reference for anyone building with these tools.