mosec
Mosec is a high-performance framework for serving ML models in the cloud. It integrates Rust for high speed and Python for ease of use, supporting dynamic batching, pipelined processing, and Kubernetes. Designed for both CPU and GPU workloads, it enables efficient online serving and scalable deployment. Suitable for developers focused on backend service development.
