hidet
Hidet is an open-source deep learning compiler optimizing DNN models from PyTorch and ONNX to CUDA kernels, tailored for efficient inference on NVIDIA GPUs. It supports Linux with CUDA 11.6+ and Python 3.8+, applying graph and operator optimizations for enhanced performance. Comprehensive documentation and community engagement facilitate ongoing development, with straightforward installation and usage to integrate into workflows.
