torchchat
torchchat facilitates smooth operation of large language models across platforms such as desktop, server, iOS, and Android. It features multimodal capabilities with the Llama3.2 11B model and integrates smoothly with PyTorch, supporting different execution modes like eager and AOT Inductor. Key features include interaction with well-known LLMs, hardware and OS compatibility, and versatile quantization and execution schemes.
