mmdeploy
MMDeploy is an open-source toolset aimed at efficiently deploying deep learning models. It supports over 2,300 AI models across key frameworks like ONNX, NCNN, TRT, and OpenVINO. Compatible with a wide range of hardware, it facilitates the conversion of Torch models to various formats. Designed for the OpenMMLab ecosystem, it integrates with models from multiple codebases such as mmdet, mmseg, and mmocr. The platform includes a C/C++ SDK for extensive customization and supports multiple inference backends on operating systems like Linux, Windows, macOS, and Android, optimizing deployment efficiency.
