magnitudedev/magnitude
Open source inference engine
Magnitude is an open source inference engine that profiles local hardware to recommend and tune the best open models for it. It supports various architectures including Apple Silicon, NVIDIA, AMD, and CPU-only systems, allowing users to connect their preferred agents with a single click.
- Stars
- 5,000
- Stars gained in 7 days
- +400
- Contributors
- 10
- Forks
- 374
- Days trending in the last 30
- 9 days
- Mark
- Watch — 500 stars per contributor. An automatic mark on public metrics: above 500 is watch, above 2,000 possible hype (not a judgement of quality).