candle
Candle is a Rust-based machine learning framework emphasizing efficient performance and ease of use, compatible with both CPU and GPU. It streamlines serverless inference by reducing the bulk of conventional frameworks, assisting developers in quick and effective deployment. Candle offers models like LLaMA, Stable Diffusion, and YOLO, as well as strong language and vision functionalities. Its features include CUDA support, multi-GPU distribution, and WASM for web-based models. Discover its rich examples ranging from text generation to image segmentation, suitable for diverse machine learning applications.
