llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2. Maintained by mgonzs13 on GitHub, where it has earned 260 stars from the community.

It's actively developed around cpp, gpt, llama, and is a solid reference for anyone building with these tools.