ctransformers
Discover unified Python bindings for Transformer models implemented with GGML in C/C++. Compatible with models like GPT-2 and LLaMA, this package supports GPU layers and integrates with Hugging Face and LangChain. Available through PyPI for easy installation, it also features experimental attributes like GPTQ and streaming, complemented by extensive documentation.