Ui.Vision
Extension Actions
CRX ID
gcbalfbdmfieckjlnblleoemohcganoc
Status
- Extension status: Featured
- Live on Store
Description from extension meta
Task and UI test automation with Computer Vision/OCR. Ui.Vision combines browser automation and desktop automation.
Image from store
Description from store
Ui.Vision is an open-source automation RPA software that combines classic browser automation with modern computer vision and OCR:
(1) Browser Automation
Ui.Vision's computer vision commands make automating tasks inside the web browser easy. Existing Selenium IDE scripts can be imported. Conversion help for iMacros scripts is provided, too.
(2) Desktop Automation for Windows, Mac, and Linux
Beyond web browser automation, Ui.Vision can interpret images and text on the desktop, executing actions like clicking, moving, dragging and dropping the mouse, and simulating keyboard inputs.
This desktop automation requires installing the free Ui.Vision XModules, available for Windows, Mac, and Linux. These modules provide Ui.Vision with the necessary capabilities for desktop interaction.
(3) Anthropic Claude Computer Use Integration
The AI commands allow you to automate complex tasks with a single line of code that would traditionally require hundreds of lines of classic commands. For example, you can teach Ui.Vision to play TicTacToe with just one short "Play this game..." prompt.
(4) Command Line API
Ui.Vision can be controlled from the command line. Thus it can be used from, and combined with, any programming or scripting language, such as Windows batch files, Linux/Mac shell scripts, Python or PowerShell.
(5) Open-Source
Ui.Vision is Open-Source. The source code is available on Github.
(6) 100% Local Software
The software does not send any data back to us or any other place. Everything, including image recognition and OCR processing, is done locally on your machine.
The only exception to the "all data is processed locally" rule is if you select the optional AI commands. But these cloud-features are disabled by default. The default computer vision (image recognition and OCR) runs 100% locally on the machine.
**Happy Automating!**
For questions and suggestions, please visit the Ui.Vision community forum at https://forum.ui.vision.
Latest reviews
- Jordan Perez
- I come from imacros. This seemed a bit intimidating at first but I am so glad I gave this a chance! The features are so robust and you have more control of the automation. Highly recommend!
- Finees Mendez
- I used to use imacros. Now I use this.
- Tomas Corej
- great tool, works much better than Power Automate
- Frustie Frustie
- This is way better, I recommend using it. Great job to developers!
- user
- As an expertise in Google Reviews, I totally recommend this extension. So be grateful, Owners, I'm Google's Special Agent, Your welcome.
- Mark Elder
- After spending some time to learn it, this is a really great tool that helps with my day to day. The CSV data import is super useful for managing xpath updates btw.
- Bekhzod Rasamatov
- Can someone please help me to set it up ? I need to download 1200 pdf invoices, it's pretty straight forward.
- Iman Mahmoudinasab
- For my day-to-day automation work, this extension works perfectly!
- Joshua McFarlane
- Good (although an extremely steep learning curve) when it works. But lately all I get is 'DOM not found' over and over again.
- Joshua McFarlane
- Good (although an extremely steep learning curve) when it works. But lately all I get is 'DOM not found' over and over again.
- ali raza
- if anyone want to create automation in UI vision extention i can help you.
- ali raza
- if anyone want to create automation in UI vision extention i can help you.
- Marco Cetina
- It really makes our life way easier!!! I love it!!!!
- Marco Cetina
- It really makes our life way easier!!! I love it!!!!
- COW KING (THE COW KING)
- seems the developer has put some effort in it, but it's still unintuitive and difficult to use, lacks simple features. I need something simple enough to just help me click a specific button on a webpage when a specific url pattern is opened (such as automatically thumbup every video I watched on youtube). sadly it's not able to do that
- COW KING (THE COW KING)
- seems the developer has put some effort in it, but it's still unintuitive and difficult to use, lacks simple features. I need something simple enough to just help me click a specific button on a webpage when a specific url pattern is opened (such as automatically thumbup every video I watched on youtube). sadly it's not able to do that
- Lulu
- Loving it so far! It is so easy to use. It is saving me a half day of work today. At first I couldn't get it to run. I then added and created another macro and saved it. Then I was able to run it! I didn't watch the tutorial so I'm sure this was discussed. No coding experience here!
- Lulu
- Loving it so far! It is so easy to use. It is saving me a half day of work today. At first I couldn't get it to run. I then added and created another macro and saved it. Then I was able to run it! I didn't watch the tutorial so I'm sure this was discussed. No coding experience here!
- iProf Evolution
- well, here is the problem, many problems I would say: first, doesnt open properly on chrome... only works in firefox. Even brave doesnt work, showing the follows "Failed to create macro: An operation that depends on state cached in an interface object was made but the state had changed since it was read from disk." I tried everything but nothing changed Second is a non option to open in another tab in easy way the links you click. At that point imacros is better and simpler to do. Third is how bad is the resize: I want to close the files tab and I cant; working in a laptop without extra monitor became a back and foward nightmare when you try to debug. Fourth is if you have an error in your json code and try to save, you dont have time to debug because automatically goes back to the previous saved version.... so all you wrote goes down to the drain, something made me furious after write some lines and because a missing } I lost everything. In the end has cool tools, a little trick to have ifelse command but eventually you get it. Need to be a lot more intuitive and for the love of god hire a good designer , the ui is horrible
- iProf Evolution
- well, here is the problem, many problems I would say: first, doesnt open properly on chrome... only works in firefox. Even brave doesnt work, showing the follows "Failed to create macro: An operation that depends on state cached in an interface object was made but the state had changed since it was read from disk." I tried everything but nothing changed Second is a non option to open in another tab in easy way the links you click. At that point imacros is better and simpler to do. Third is how bad is the resize: I want to close the files tab and I cant; working in a laptop without extra monitor became a back and foward nightmare when you try to debug. Fourth is if you have an error in your json code and try to save, you dont have time to debug because automatically goes back to the previous saved version.... so all you wrote goes down to the drain, something made me furious after write some lines and because a missing } I lost everything. In the end has cool tools, a little trick to have ifelse command but eventually you get it. Need to be a lot more intuitive and for the love of god hire a good designer , the ui is horrible
- Romain Fromheim
- Very powerful yet with a reasonable learning curve, really like it.
- Romain Fromheim
- Very powerful yet with a reasonable learning curve, really like it.
- Anonymous
- Looks promising, but I cannot seem to get the macros to run after recording. The play Macro button does nothing.
- Wilbert Cedeno
- I tried many automation extensions. Axiom worked, but was slow. All the other ones were hard to set up. This one worked really well and it was easy to use! Thanks!
- Wilbert Cedeno
- I tried many automation extensions. Axiom worked, but was slow. All the other ones were hard to set up. This one worked really well and it was easy to use! Thanks!
- Matheus Carmo
- From what I check in FORUM Error#301 XMODULE REALUSER nerver was solved... Error #301: RealUser Simulation XModule is not installed yet
- Matheus Carmo
- From what I check in FORUM Error#301 XMODULE REALUSER nerver was solved... Error #301: RealUser Simulation XModule is not installed yet
- Gameplayz
- randomly breaks after some time of running
- Gameplayz
- randomly breaks after some time of running
- Gustavo Castro Leonel
- não funciona
- Sean Chen
- I just got this extension and I want to know if this extension has a hotkey setting
- Sean Chen
- I just got this extension and I want to know if this extension has a hotkey setting
- yong liu
- 运行起来很慢，记录功能还有速度都没有Selenium IDE好，不过功能强大点
- Mateusz Borowik
- Fajne, Polecam.
- Outliner Itoh Takashi
- Chromebookでまともに動作しない。
- januar andan
- doesnt really worked after update
- januar andan
- doesnt really worked after update
- MOLI MOLI (MOLI)
- 用了十几年IMACROS了，但是一直用的老板的无限制的插件，实在跟不上时代了。。试试这个，就是教程太少了。。。主要IMACROS一直用得很顺手。
- PAULO VINICIUS DE JESUS CASTILHO
- Ótimo, se souber usar faz o que promete e permite customizar a automação.
- Steven Zhi
- 非常好用, 希望能有中文版, 我自己的英文太差, 无法完全理解各种功能的用途
- Nate Levy
- Worked great until today, now it won't load at all. Clicking the icon doesn't do anything anymore and going to extension options crashes the browser. Can't get to my tests to switch browsers
- Nate Levy
- Worked great until today, now it won't load at all. Clicking the icon doesn't do anything anymore and going to extension options crashes the browser. Can't get to my tests to switch browsers
- Pran Krishna Das
- Thank you to make life easier! :)
- Pran Krishna Das
- Thank you to make life easier! :)
- Komik Kardus
- BEST!!
- Komik Kardus
- BEST!!
- Stanislav Ginzburg
- well, where I can get downloaded zip for extension?
- Stanislav Ginzburg
- well, where I can get downloaded zip for extension?
- Jack Faulkner
- So happy something like this exists and works so well. The documentation and support forum are great too.
- Dennis Bareis
- In general this is a good product, it is very hard to work out as a beginner as there is no good introductory youtube videos or documentation. A good hint to get started is to click this browser extension's icon after installation. There are samples but these are uncommented, not sure what the logic is here... It's "command line" is quirky and should be an exe to make life easier.