Skip to main content

Open source inference

Home Model Catalog Documentation Blog Community

Home Model Catalog Documentation Blog Community

Quickstart GitHub (opens in a new window)

Model Catalog/Recipe details

● Build baseline · 5b668ffBaseline retrieved 2026-10-22

Model and recipe details

Live model and recipe details require JavaScript.Read the source catalog

ModelSphere

ModelSphere is an open source production inference infrastructure community co-founded by Phancy and RiseUnion. It connects heterogeneous hardware, cloud-native scheduling, and performance tuning to bring LLMs from the lab into production.

Core products

Inference engine runtime Model acceleration toolkit Performance benchmarks Distributed orchestrator

Community and ecosystem

Developer SIG Community governance Contributors Community event calendar

Developer resources

Getting started docs RESTful / gRPC API Architecture insights Quantization case studies

© 2025 ModelSphere Foundation. Released under Apache-2.0 License.