Screen reader and content analyzer powered by Web AI and Chrome's built-in AI, featuring Moondream2 and Gemini Nano.
A-Eye Web Chat Assistant - Your AI-Powered Web Companion
Transform your browsing experience with Chrome's built-in AI and Web AI technologies. A-Eye delivers intelligent voice control, real-time image descriptions, and smart web content analysis while keeping your data private.
✨ Features You'll Love:
- Talk to Your Browser: Control your browser naturally with voice commands.
- See Through AI: Instant image descriptions and visual content analysis.
- Smart Content Helper: Summaries and explanations for any web content.
- Privacy First: All AI processing happens locally in your browser.
🎯 Powered by Advanced AI:
- Chrome's Gemini Nano: Built-in AI for powerful content understanding.
- Web AI Technology: Smart image recognition and real-time processing.
- No Cloud Required: Everything runs locally on your device.
⚡Visit the following link for more details.
https://github.com/vincentwun/A-Eye-Web-Chat-Assistant/blob/main/README.md
⚠️ Important Steup:
1. To experience the capabilities of the Built-in AI model, you need to install Chrome Dev/Canary (version ≥ 128.0.6545.0).
2. To enable these essential Chrome flags:
- `chrome://flags/enable-webgpu-developer-features` select Enabled
- `chrome://flags/optimization-guide-on-device-model` select Enabled BypassPerfRequirement
- `chrome://flags/prompt-api-for-gemini-nano` select Enabled
- Restart the Chrome Dev/Canary
3. Go to chrome://components and verify that the Optimization Guide On Device Model version is ≥ 2024.5.21.1031.
💡 How to Use
Keyboard Shortcuts
- Alt + Shift + Q: Open A-Eye Web Chat Assistant.
- Alt + Shift + 1: Activate voice control for browser and extension operations.
- Alt + Shift + 2: Interact with the AI for further insights after executing specific commands.
*(e.g., after taking a screenshot or analyzing content, press Alt + Shift + 2 to chat with the AI.)*
- Alt + Shift + 3: Repeat the AI's last response.
Voice Commands
> 💬 Reminder: Grant microphone access to the extension for using voice features.
1. Search
- Command: `"Search [query]"`
- Example: `"Search the weather today"`
- Action: Opens a Google search for the specified query.
2. Navigate to a Website
- Command: `"Go to [website]"`
- Example: `"Go to google.com"`
- Action: Opens the specified website. *(The `.com` suffix is optional.)*
3. Take Screenshot
- Commands:
- `"Take a screenshot"`
- Action: Captures a screenshot of the current view. The AI can describe the image content.
4. Take Scrolling Screenshot
- Commands:
- `"Take a scrolling screenshot"`
- Action: Captures a scrolling screenshot. The AI can provide a description of the image.
5. Analyze Content
- Commands:
- `"Analyze content"`
- Action: Performs content analysis on the current page using Gemini Nano.