ml-engineering
Discover a comprehensive collection of methodologies, tools, and step-by-step guides designed for training large language and multi-modal models, aimed at engineers and ML operators. This resource includes practical scripts and commands and draws from the author's experience with models such as BLOOM-176B and IDEFICS-80B, as well as ongoing work with RAG models at Contextual.AI. It covers crucial aspects from hardware configurations to debugging and orchestration, supporting efficient development and inference of advanced machine learning models. Follow updates and enhancements through social media.