Ui.Vision icon

Ui.Vision

Extension Actions

CRX ID
gcbalfbdmfieckjlnblleoemohcganoc
Status
  • Extension status: Featured
  • Live on Store
Description from extension meta

Task and UI test automation with Computer Vision/OCR. Ui.Vision combines browser automation and desktop automation.

Image from store
Ui.Vision
Description from store

Ui.Vision is an open-source automation RPA software that combines classic browser automation with modern computer vision and OCR:

(1) Browser Automation

Ui.Vision's computer vision commands make automating tasks inside the web browser easy. Existing Selenium IDE scripts can be imported. Conversion help for iMacros scripts is provided, too.

(2) Desktop Automation for Windows, Mac, and Linux

Beyond web browser automation, Ui.Vision can interpret images and text on the desktop, executing actions like clicking, moving, dragging and dropping the mouse, and simulating keyboard inputs.

This desktop automation requires installing the free Ui.Vision XModules, available for Windows, Mac, and Linux. These modules provide Ui.Vision with the necessary capabilities for desktop interaction.

(3) Anthropic Claude Computer Use Integration

The AI commands allow you to automate complex tasks with a single line of code that would traditionally require hundreds of lines of classic commands. For example, you can teach Ui.Vision to play TicTacToe with just one short "Play this game..." prompt.

(4) Command Line API

Ui.Vision can be controlled from the command line. Thus it can be used from, and combined with, any programming or scripting language, such as Windows batch files, Linux/Mac shell scripts, Python or PowerShell.

(5) Open-Source

Ui.Vision is Open-Source. The source code is available on Github.

(6) 100% Local Software

The software does not send any data back to us or any other place. Everything, including image recognition and OCR processing, is done locally on your machine.

The only exception to the "all data is processed locally" rule is if you select the optional AI commands. But these cloud-features are disabled by default. The default computer vision (image recognition and OCR) runs 100% locally on the machine.

**Happy Automating!**

For questions and suggestions, please visit the Ui.Vision community forum at https://forum.ui.vision.

Latest reviews

Jordan Perez
I come from imacros. This seemed a bit intimidating at first but I am so glad I gave this a chance! The features are so robust and you have more control of the automation. Highly recommend!
Finees Mendez
I used to use imacros. Now I use this.
Tomas Corej
great tool, works much better than Power Automate
Frustie Frustie
This is way better, I recommend using it. Great job to developers!
user
As an expertise in Google Reviews, I totally recommend this extension. So be grateful, Owners, I'm Google's Special Agent, Your welcome.
Mark Elder
After spending some time to learn it, this is a really great tool that helps with my day to day. The CSV data import is super useful for managing xpath updates btw.
Bekhzod Rasamatov
Can someone please help me to set it up ? I need to download 1200 pdf invoices, it's pretty straight forward.
Iman Mahmoudinasab
For my day-to-day automation work, this extension works perfectly!
Joshua McFarlane
Good (although an extremely steep learning curve) when it works. But lately all I get is 'DOM not found' over and over again.
Joshua McFarlane
Good (although an extremely steep learning curve) when it works. But lately all I get is 'DOM not found' over and over again.
ali raza
if anyone want to create automation in UI vision extention i can help you.
ali raza
if anyone want to create automation in UI vision extention i can help you.
Marco Cetina
It really makes our life way easier!!! I love it!!!!
Marco Cetina
It really makes our life way easier!!! I love it!!!!
COW KING (THE COW KING)
seems the developer has put some effort in it, but it's still unintuitive and difficult to use, lacks simple features. I need something simple enough to just help me click a specific button on a webpage when a specific url pattern is opened (such as automatically thumbup every video I watched on youtube). sadly it's not able to do that
COW KING (THE COW KING)
seems the developer has put some effort in it, but it's still unintuitive and difficult to use, lacks simple features. I need something simple enough to just help me click a specific button on a webpage when a specific url pattern is opened (such as automatically thumbup every video I watched on youtube). sadly it's not able to do that
Lulu
Loving it so far! It is so easy to use. It is saving me a half day of work today. At first I couldn't get it to run. I then added and created another macro and saved it. Then I was able to run it! I didn't watch the tutorial so I'm sure this was discussed. No coding experience here!
Lulu
Loving it so far! It is so easy to use. It is saving me a half day of work today. At first I couldn't get it to run. I then added and created another macro and saved it. Then I was able to run it! I didn't watch the tutorial so I'm sure this was discussed. No coding experience here!
iProf Evolution
well, here is the problem, many problems I would say: first, doesnt open properly on chrome... only works in firefox. Even brave doesnt work, showing the follows "Failed to create macro: An operation that depends on state cached in an interface object was made but the state had changed since it was read from disk." I tried everything but nothing changed Second is a non option to open in another tab in easy way the links you click. At that point imacros is better and simpler to do. Third is how bad is the resize: I want to close the files tab and I cant; working in a laptop without extra monitor became a back and foward nightmare when you try to debug. Fourth is if you have an error in your json code and try to save, you dont have time to debug because automatically goes back to the previous saved version.... so all you wrote goes down to the drain, something made me furious after write some lines and because a missing } I lost everything. In the end has cool tools, a little trick to have ifelse command but eventually you get it. Need to be a lot more intuitive and for the love of god hire a good designer , the ui is horrible
iProf Evolution
well, here is the problem, many problems I would say: first, doesnt open properly on chrome... only works in firefox. Even brave doesnt work, showing the follows "Failed to create macro: An operation that depends on state cached in an interface object was made but the state had changed since it was read from disk." I tried everything but nothing changed Second is a non option to open in another tab in easy way the links you click. At that point imacros is better and simpler to do. Third is how bad is the resize: I want to close the files tab and I cant; working in a laptop without extra monitor became a back and foward nightmare when you try to debug. Fourth is if you have an error in your json code and try to save, you dont have time to debug because automatically goes back to the previous saved version.... so all you wrote goes down to the drain, something made me furious after write some lines and because a missing } I lost everything. In the end has cool tools, a little trick to have ifelse command but eventually you get it. Need to be a lot more intuitive and for the love of god hire a good designer , the ui is horrible
Romain Fromheim
Very powerful yet with a reasonable learning curve, really like it.
Romain Fromheim
Very powerful yet with a reasonable learning curve, really like it.
Anonymous
Looks promising, but I cannot seem to get the macros to run after recording. The play Macro button does nothing.
Wilbert Cedeno
I tried many automation extensions. Axiom worked, but was slow. All the other ones were hard to set up. This one worked really well and it was easy to use! Thanks!
Wilbert Cedeno
I tried many automation extensions. Axiom worked, but was slow. All the other ones were hard to set up. This one worked really well and it was easy to use! Thanks!
Matheus Carmo
From what I check in FORUM Error#301 XMODULE REALUSER nerver was solved... Error #301: RealUser Simulation XModule is not installed yet
Matheus Carmo
From what I check in FORUM Error#301 XMODULE REALUSER nerver was solved... Error #301: RealUser Simulation XModule is not installed yet
Gameplayz
randomly breaks after some time of running
Gameplayz
randomly breaks after some time of running
Gustavo Castro Leonel
não funciona
Sean Chen
I just got this extension and I want to know if this extension has a hotkey setting
Sean Chen
I just got this extension and I want to know if this extension has a hotkey setting
yong liu
运行起来很慢,记录功能还有速度都没有Selenium IDE好,不过功能强大点
Mateusz Borowik
Fajne, Polecam.
Outliner Itoh Takashi
Chromebookでまともに動作しない。
januar andan
doesnt really worked after update
januar andan
doesnt really worked after update
MOLI MOLI (MOLI)
用了十几年IMACROS了,但是一直用的老板的无限制的插件,实在跟不上时代了。。试试这个,就是教程太少了。。。主要IMACROS一直用得很顺手。
PAULO VINICIUS DE JESUS CASTILHO
Ótimo, se souber usar faz o que promete e permite customizar a automação.
Steven Zhi
非常好用, 希望能有中文版, 我自己的英文太差, 无法完全理解各种功能的用途
Nate Levy
Worked great until today, now it won't load at all. Clicking the icon doesn't do anything anymore and going to extension options crashes the browser. Can't get to my tests to switch browsers
Nate Levy
Worked great until today, now it won't load at all. Clicking the icon doesn't do anything anymore and going to extension options crashes the browser. Can't get to my tests to switch browsers
Pran Krishna Das
Thank you to make life easier! :)
Pran Krishna Das
Thank you to make life easier! :)
Komik Kardus
BEST!!
Komik Kardus
BEST!!
Stanislav Ginzburg
well, where I can get downloaded zip for extension?
Stanislav Ginzburg
well, where I can get downloaded zip for extension?
Jack Faulkner
So happy something like this exists and works so well. The documentation and support forum are great too.
Dennis Bareis
In general this is a good product, it is very hard to work out as a beginner as there is no good introductory youtube videos or documentation. A good hint to get started is to click this browser extension's icon after installation. There are samples but these are uncommented, not sure what the logic is here... It's "command line" is quirky and should be an exe to make life easier.