llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2. Maintained by mgonzs13 on GitHub, where it has earned 258 stars from the community.

It's actively developed around audio, cpp, embeddings, and is a solid reference for anyone building with these tools.