JustVugg/colibri
Pure C inference engine
A lightweight inference engine written in pure C that runs large mixture-of-experts models on consumer hardware. It treats storage, RAM, and VRAM as a unified memory hierarchy to stream model experts from disk without external dependencies.
- Stars
- 37,500
- Stars gained in 7 days
- +1,900
- Contributors
- 153
- Forks
- 4,100
- Days trending in the last 30
- 10 days