Get image captions for all images by right-clicking them
Use the power of AI to caption images with a simple right-click.
Let's make the web a more accessible place.
What is this?
Auto Alt Text is a chrome extension that can generate descriptive captions for pictures.
Currently, users who are visually impaired must rely on metadata and alt-text descriptions put in by website developers in order to understand what an image actually contains. However, not all web developers take the time to caption all their images. This is where Auto Alt Text steps in.
Using artificial intelligence, the extension can analyze an image and detect the contents of the scene depicted in it within 5 seconds!
How does it work?
It's pretty simple to get up and running!:
Download the extension
Right click on any image element (note does not work with background images at the moment)
Click "Get Image Info" from the dropdown
Wait a few seconds and get your caption
What is the tech behind it?
Auto Alt Text is based off of the im2txt model which was created by Vinyals et al for the 2015 MCOCO Image Captioning Challenge.
The model itself is based off of a encoder-decoder neural network (basically a deep conv net paired with a LSTM). The deep conv net first encodes an image into a vector representation using Inception v3 (a popular image recognition model). The LSTM then creates a captioning model based on the Inception v3 encodings.
I converted the model into an API and pared it down so that it could fit on a Lambda instance and stay loaded into memory for blazing fast responses under 5 seconds (compared to the > 15 seconds needed for the model to classify out of the box).
Latest reviews
- (2021-11-02) Wanda Nester: This is nothing less than garbage occupying my valuable computer memory. I pulled up paper image...it said it was a pair of scissors; I pulled up a necklace image...it said it was a pair of scissors; I pulled up a set of 3 pull chains for lights and it said it was 2 pairs of scissors. I guess it thinks the entire world is one giant pair of scissors. LOL You should remove this from the store as it is a total dud!
- (2021-09-29) Boots Highland: Doesn't work at all. Just says, "There was an error processing your image." ¯\_(ツ)_/¯
- (2021-09-15) Sean Lazenby: Simply said. Aweful.
- (2020-09-04) Fabrizio Mori: This is the message that i received every time i've tried to process an image: "There was an error contacting the servers to process your image"
- (2020-08-21) Qasim Sabbir Sabbir: Can't connect to the Server Press Enter to Close this Window just this Nothing Rest ! is it really work or just a bluff
- (2020-08-19) Ártemis López: It guesses very incorrectly, which I guess is an issue of AI training, but the real issue is that when images DO have image descriptions, it ignores those descriptions and comes up with its own (very wrong) interpretation.
- (2020-04-15) It was able to detect a few correct objects, however, it kept thinking that ties were in photos when there were none. At least it gave me a good laugh this morning.
- (2019-01-23) Mr. Lance E Sloan: It works, but it is very, very, VERY ugly. The support website (http://abhinavsuri.com/aat/install/ is the correct URL. The "Support" link in the Chrome web store is broken.) claims that this is using AI. That is extremely doubtful. I don't feel like wasting time to look at the source code of the extension, but I suspect it's a very simple lookup from the page source, not AI.
- (2017-08-25) Samuli Pahaoja: Works as advertised.
Statistics
Installs
2,000
history
Category
Rating
2.3 (10 votes)
Last update / version
2021-12-06 / 1.0.0.3
Listing languages
en