llmperf
Explore a robust tool for assessing LLM API performance through load and correctness tests. Learn how it benchmarks latency, throughput, and accuracy across platforms like OpenAI and Hugging Face, ensuring reliable token counting with LlamaTokenizer. Includes advanced usage insights for developing new LLM clients.
