crowdllama

CrowdLlama is a distributed system that leverages the open-source Ollama project to run LLM inference tasks across multiple nodes using peer-to-peer (P2P) networking, enabling collaborative large language model inference workloads. Maintained by crowdllama on GitHub, where it has earned 29 stars from the community.

It's actively developed around ai, llm, ollama, and is a solid reference for anyone building with these tools.