NVIDIA-NeMo/Switchyard
LLM traffic routing library
Switchyard is an open-source library that routes AI agent requests across different models and providers to balance cost, latency, and performance. It maintains native API compatibility with major providers while enabling flexible model selection and benchmarking.
- Stars
- 3,200
- Stars gained in 7 days
- +100
- Contributors
- 62
- Forks
- 305
- Days trending in the last 30
- 3 days