Nucleo AI Alpha
Nucleo AI Alpha is an innovative AI assistant application that seamlessly combines artificial intelligence capabilities with traditional personal productivity tools. This cutting-edge software is designed to operate in the background, efficiently managing multiple chats, handling various tasks, and processing stream/feed entries, thus significantly enhancing user productivity.
Overview and Video Demo
Nucleo AI Alpha, although still in its alpha stage, provides a glimpse into its promising future. It may have a few bugs and issues typical of early software releases. Users should exercise caution, especially with paid APIs, as some functions, like the assistant mode, can consume a substantial number of tokens. Check out the demo video on GitHub for a better understanding of its dynamic capabilities: Demo Video.
Installation and Setup
To start with Nucleo AI, you'll need Python 3 and Git installed on your system. The app is designed to be lightweight; however, it requires downloading large files for embeddings and cross encoders, approximately 850 MB. The application needs an openai-compatible endpoint such as llama.cpp or Oobabooga for the language model operation. Here's a simplified setup guide:
Step 1: Initial Installation
Begin by cloning the repository. If you're using Windows, additional installation notes can be found here.
$ git clone [email protected]:AndrewVeee/nucleo-ai.git
# Create python virtual environment, install torch CPU-only, and execute requirements.
$ ./setup.sh
Step 2: Configuration
After the initial setup, edit the config.toml file located in ./data/. Particularly, set your openai_base_url (e.g., http://localhost:5000/v1) and provide an openai_api_key if necessary. You also have the option to secure your connection with a secret_key.
Step 3: Start the Application
To launch the app, run:
$ ./start.sh
The first launch might take a while as it downloads necessary models for Retrieval-Augmented Generation (RAG) support. Once running, it provides a URL (e.g., http://127.0.0.1:4742) for accessing the app via your browser.
Step 4: Feedback
Once you've had a chance to explore Nucleo AI, consider sharing your thoughts on r/nucleoai to help improve the application.
Key Features
Nucleo AI offers several features:
- Regular Chat: Engage in multi-chat scenarios, with options for storing chats or using temporary sessions.
- Assistant Mode: Automate tasks, conduct web searches, and manage documents through AI, although it's early days for assured accuracy.
- Researcher Feature: Allow the AI to delve into a topic, proposing subtopics, performing web searches, and compiling findings into a document.
- Document Management (RAG): Upload PDFs or create documents by pasting URLs, enabling DOC chat mode for content retrieval and responsive interactions.
- Stream and Actions: View a history of tasks completed by the assistant or add entries for future replay, including various chat types.
- To-Do List: A simple task manager to add, edit, or remove entries, with potential AI-mediated additions.
Looking Forward
Nucleo AI is currently in an exploratory phase, soliciting feedback and ideas for further enhancements. Future aspirations include:
- Enhanced Researcher Functionality: Automating topic exploration and live documentation.
- Diverse Assistant Modes: Implementing varied, adaptable modes to suit different models.
- Comprehensive Integrations: Unified email, calendar, and personal data sources for streamlined productivity.
- Expansive Functionality: Developing widely requested features.
- Fine-Tuned Models: Utilizing small, specialized models for optimal performance.
Developer Insights
Nucleo AI aims to be a robust platform enabling developers to innovate and trial creative ideas. Although the current codebase is still developing, interested contributors are welcome, with guidance available for creating and connecting virtual models.
Community and Support
For help and discussions, you can join the Nucleo AI subreddit or post queries on the project's issues tab for community or developer assistance.
Nucleo AI stands at the forefront of AI-driven productivity tools, inviting users and developers alike to participate in transforming it into a daily essential.