flash-head

FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference. Maintained by embedl on GitHub, where it has earned 13 stars from the community.

It's actively developed around generative-ai, optimization, vllm, and is a solid reference for anyone building with these tools.