attorch
Attorch is a Python library derived from PyTorch, utilizing Triton for optimized neural network modules. Developed for easy customization, it includes layers applicable to various fields beyond NLP, like computer vision, supporting both training and inference processes. Attorch provides an efficient pathway to develop custom deep learning operations while using familiar PyTorch functionalities. With minimal dependencies, it blends effortlessly with current PyTorch setups, offering fallback options and robust testing capabilities. It is well-suited for developers looking to enhance performance without deep CUDA knowledge.
