lunary - Comprehensive Tools for Enhancing LLM Chatbot Performance

Overview of Lunary

Lunary is a sophisticated toolkit designed specifically for developers creating Large Language Model (LLM) chatbots. It provides a range of features to streamline the development process, enhance performance, and facilitate collaboration. This innovative toolkit allows developers to efficiently build and manage chatbots with ease, regardless of the underlying AI model employed.

Core Features

Lunary offers an array of compelling features aimed at improving chatbot development and functionality:

Conversation & Feedback Tracking: This feature allows developers to monitor and analyze interactions with users for continuous improvement.
Analytics: Lunary provides detailed insights into costs, token usage, and latency, helping developers optimize their chatbot operations.
Debugging Tools: With access to logs, traces, and user tracking, developers can easily identify and resolve potential issues.
Prompt Directory: This tool aids in prompt versioning and facilitates team collaboration, maintaining consistency and quality in chatbot interactions.
Dataset Creation: Lunary allows for the creation of fine-tuning datasets, enabling developers to refine and enhance their models.
Automatic Topic Classification: This feature helps in categorizing the conversation topics automatically, enhancing the chatbot's responsiveness.

Designed to be developer-friendly, Lunary boasts the following qualities:

Compatibility with Any Model: It is designed to be used with any LLM, not just limited to OpenAI models.
Easy Integration: Lunary integrates seamlessly within minutes into existing workflows.
Self-Hostable: For those preferring in-house hosting, Lunary offers self-hosting capabilities.

Integration Possibilities

Lunary comes equipped with modules for both JavaScript and Python, providing flexibility in implementation. The toolkit natively supports several platforms:

LangChain: Available for both JS and Python, it assists with integrative chatbot functionalities.
OpenAI Module: Enrich chatbots with OpenAI’s expansive capabilities.
LiteLLM: Offers integration resources for a smooth Lunary experience.
Flowise: Integrate easily for streamlined chatbot management.

For other LLM systems, developers can manually send events to integrate Lunary seamlessly.

Hosted Solutions

For developers seeking effortless operations without the worry of managing updates or operations, Lunary offers a hosted version with a free plan allowing up to 10,000 requests monthly. Some advantages of the hosted version include:

Exemption from managing server setups or updates.
Priority personalized support from the Lunary team.
Secure data storage, with data kept within Europe.

Local Deployment

Lunary can be run locally by following these steps:

Clone the Lunary repository.
Set up a PostgreSQL instance (version 15 or newer).
(Backend) Copy and customize environment settings: packages/backend/.env.example to packages/backend/.env.
(Frontend) Copy and customize environment settings: packages/frontend/.env.example to packages/backend/.env.
Run the command npm install to set up dependencies.
Execute npm run migrate:db for database migration.
Launch the application with npm run dev.

The dashboard can then be accessed at http://localhost:8080. When utilizing the JS or Python SDK, it’s essential to configure the LUNARY_API_URL to http://localhost:3333. Enable LUNARY_VERBOSE=True to monitor SDK activity.

Getting Support

For additional help, Lunary offers various support channels. Users can find assistance on the website or reach out directly via email at [email protected].

Licensing

Lunary is distributed under the Apache 2.0 License, ensuring an open, secure, and continually improving development environment for all users.