Project Overview: Lumos
Lumos is an innovative Chrome extension acting as an AI co-pilot for web browsing, using local Large Language Models (LLMs). This means that the extension doesn't require any remote server support, ensuring a secure and private browsing experience. Instead, it operates via a local server setup, allowing you to harness the power of LLMs directly from your machine. The extension uses technology from Ollama, a platform renowned for its AI and machine learning capabilities, and draws inspiration from various projects and technologies within the AI community.
Key Features and Use Cases
Summarization Abilities
Lumos excels at breaking down lengthy discussions from issue tracking sites, forums, and social media platforms. It can also effectively summarize news articles, providing quick insights.
Question & Answer Interaction
Users can interact with reviews on business and product pages, asking Lumos specific questions to glean deeper insights. Additionally, it handles inquiries related to comprehensive technical documents efficiently.
Versatility
The extension’s flexibility doesn't stop there, as its capabilities can extend beyond these core tasks, depending on user needs.
Getting Started with Ollama
Setting Up Ollama
Lumos requires a local instance of the Ollama server to function. You can download and install the necessary components from the Ollama website.
Initial Configuration
To start using the server, you can pull an image and launch the server. It’s crucial to set the OLLAMA_ORIGINS
environment variable correctly to allow communication between the Chrome extension and the local server, avoiding potential errors related to Cross-Origin Resource Sharing (CORS).
macOS and Docker Configuration
Mac users can set environment variables using launchctl
, while Docker offers an alternative way to run the Ollama server, ensuring flexibility in setup for different user environments.
Chrome Extension Interaction
Running Tests and Building
Developers can conduct tests and build the application for production using simple npm commands, ensuring the extension is optimized and ready for deployment.
Installation and Usability
The extension can be installed by loading the unpacked version in Chrome. Users can also set up keyboard shortcuts for easier access to Lumos functionalities.
Modifying Lumos Options
Users have the freedom to adjust Lumos settings for a tailored experience. These options include selecting different AI models, configuring the host, and adjusting cache settings for optimal performance.
Enhanced Content Parsing
Lumos offers robust content parsing capabilities with customizable configurations. Users can specify how content from web pages should be extracted and analyzed, ensuring the extension meets diverse needs effectively.
Personalized Content Interaction
By configuring content parsers for specific URL paths, users can dictate exactly how Lumos should handle and analyze content from different websites.
File Attachments and Multimodal Support
Lumos allows file uploads for processing through its AI workflow, supporting various text and image file formats. This feature emphasizes its capability to handle diverse content types effectively.
Experimental Tools
Lumos includes experimental features, leveraging tools to automate specific tasks based on user prompts, expanding its utility in different contexts.
Further Reading
For those interested in deeper technical insights, several articles and resources are available exploring the technologies behind Lumos and its applications in browser-based AI tools.
Lumos stands out by offering a comprehensive, local AI-powered browsing assistant that maintains user privacy and integrity, while delivering powerful web browsing augmentation through its diverse functionalities.