OpenDelta
OpenDelta offers a versatile framework for parameter-efficient tuning, referred to as delta tuning. It allows tweaking selective parameters while keeping most unchanged, with support for methods like prefix-tuning and LoRA applicable to diverse pre-trained models. It is compatible with Python 3.8.13 and PyTorch 1.12.1, but adaptable to other versions. Recent updates enhance documentation and BMTrain integration, providing tools to inspect model modifications.
