Firefly
Firefly is a versatile tool for training large models, offering pre-training, instruction fine-tuning, and DPO functionality for a broad range of popular models, including Llama3 and Vicuna. It employs methodologies such as full parameter tuning, LoRA, and QLoRA for efficient resource usage, catering to users with limited computing power. Its user-friendly approach allows for straightforward model training with optimized configurations to minimize memory and time consumption. Discover open-source model weights and benefit from proven methods, achieving notable improvements in the Open LLM Leaderboard.
