nano-llama31
This project provides a streamlined implementation of Llama 3.1 with minimal dependencies, simplifying training, finetuning, and inference. Unlike Meta's official release, this version focuses on the 8B base model, minimizing complexity and dependencies. It offers early finetuning on the Tiny Stories dataset and avenues for future enhancements, making it suitable for developers seeking a simplified Llama 3.1 application.