build_MiniLLM_from_scratch
The project develops a compact large language model for basic chat functionality using the bert4torch framework, focusing on pre-training and instruction fine-tuning. It ensures efficient memory use and integrates smoothly with transformers. While its primary function is simple chat, updates aim to enhance conversational capabilities using extensive datasets and improved training techniques.
