runanywhere-sdks by RunanywhereAI

Cross-platform on-device AI toolkit. Maintained by xybrid-ai on GitHub, where it has earned 339 stars from the community.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama. Maintained by gluonfield on GitHub, where it has earned 5,981 stars from the community.

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers. Maintained by gotzmann on GitHub, where it has earned 169 stars from the community.