llm-gateway
Interact with major LLM providers including OpenAI and Cohere securely through a robust gateway offering PII scrubbing. Supports multiple models such as GPT and Jurassic-2, promoting easy API interaction via OpenAI's /ChatCompletion. Includes setup guidance for integrating Cohere, OpenAI, and AWS Bedrock APIs. Designed for developers, the project utilizes Poetry and Pyenv for backend, and npm with yarn for frontend dependencies, facilitating a seamless Docker-supported installation.