aikit
AIKit is an adaptable platform for hosting, deploying, and fine-tuning large language models (LLMs). It offers OpenAI API-compatible tools, supports LocalAI for inference, and provides a flexible fine-tuning interface through Unsloth. Its minimal image size enhances security, and it supports multi-modal models and OpenAI API clients. AIKit is suitable for air-gapped environments and allows multiple model hosting with one image. It can be deployed on Kubernetes and supports AMD64, ARM64, and NVIDIA GPUs for faster inferencing.
