Introduction to Chatty
Chatty is a cutting-edge project designed to provide a private and efficient in-browser AI experience. It uses WebGPU technology to run large language models directly in your web browser, ensuring that all processing occurs locally on your device for enhanced privacy and functionality. This innovative platform delivers a rich set of features, catering to those looking for a robust AI interaction without compromising on security or usability.
Core Features
In-Browser Privacy
One of the standout features of Chatty is its full commitment to in-browser privacy. The AI models operate entirely on your local hardware, meaning your data never leaves your device, offering a level of privacy unmatched by server-based alternatives.
Offline Functionality
After downloading the initial AI model, users can interact with Chatty without requiring an active internet connection, adding a layer of convenience and versatility.
Chat History Management
Users can easily access and manage their conversation history, making it easy to revisit previous interactions.
Support for Open-Source Models
Chatty supports interactions with popular open-source models such as Gemma, Llama2 & 3, and Mistral, giving users a diverse range of AI personalities and capabilities to explore.
Responsive and Intuitive Design
The platform is optimized for responsiveness, allowing seamless use on both desktop and mobile devices that support WebGL. Its user interface draws inspiration from popular AI interfaces like Gemini and ChatGPT, ensuring a familiar experience for users.
Markdown and Code Highlighting
Chatty enhances messages by supporting markdown display and highlighting code, making interactions more interactive and accessible, especially for technical queries.
Local File Interaction
Users can load various file types, including PDFs and code files, to query the models about their contents locally. This feature ensures that sensitive documents are processed only on your devices, protecting confidentiality.
Custom Memory Support
The AI can be customized with specific memory and instructions, offering more tailored and personalized responses.
Export and Voice Input Capabilities
Chatty allows users to export chat messages in JSON or markdown formats and supports voice input, streamlining communication without keyboard use.
Response Regeneration and Thematic Modes
If an AI's response isn’t quite right, it can be regenerated without retyping the prompt. Additionally, users can switch between light and dark modes for optimal viewing comfort.
Why Chatty?
The essence of Chatty is to bring the features and familiarity of popular AI platforms into a private, browser-based environment. It seeks to provide users with a secure, efficient alternative to widely used AI interfaces while maintaining high functionality and an excellent user experience.
Installation Guidelines
For those interested in trying out Chatty, it is available online via its website. For local installation, the project requires Node.js (version 18 or higher) and npm. Users can clone the repository from GitHub, install necessary dependencies, and run the project locally through straightforward commands detailed in the installation guide. Docker support is also available, although still in the optimization phase for production use.
Future Developments
The development roadmap for Chatty includes the ability to embed multiple files in a session and the introduction of a prompt management system for streamlined session interactions.
Contribution and Collaboration
Chatty welcomes community contributions. Interested individuals are encouraged to review the project’s contribution guidelines and collaborate to enhance this burgeoning AI platform.
Acknowledgements
Chatty is built on the robust frameworks and technology stacks provided by the WebLLM project, HuggingFace, and LangChain. The combined efforts of these platforms and the broader open-source community significantly contribute to Chatty's capabilities.
By bringing extensive AI functionalities into the web browser with privacy-centric features, Chatty aims to redefine how users interact with artificial intelligence, making it a valuable tool for personal and professional use alike.