bolt
Bolt, a library for efficient neural network deployment, offers over 15% speed improvement compared to other open-source libraries. It facilitates model conversion from Caffe, ONNX, TFLite, and TensorFlow, supporting multiple inference precisions such as FP32 and 1-BIT. Bolt's compatibility spans various platforms, including ARM and X86 CPUs and GPUs from diverse vendors. It pioneers support for NLP alongside CV applications, featuring advanced graph optimization, efficient thread settings, and algorithm tuning. Extensively used in HUAWEI departments, Bolt is a reliable tool enhancing performance in CV, NLP, and recommendation applications.