extension ExtPose

LipSurf - Voice Control for the Web

Description from extension meta

Control the browser with your voice instead of your hands. Use speech recognition to fill forms, open tabs, click links etc!

Image from store LipSurf - Voice Control for the Web
Description from store Browse the web with your voice -- eating, multitasking or just to give your hands a break. Speech recognition for executing commands in the browser that would normally require a mouse and keyboard. An excerpt of the basic commands: * Scroll up, down, little down, little up, autoscroll, bottom, top... * Play, pause, mute videos... * Dictate text input (Premium), open arbitrary urls (Premium) * Push-to-talk key, wake-word (say "hey LipSurf" to turn it on) (Premium) * Click anything on the page by saying "tag" then saying the annotation in the yellow box next to it. * Next tab, previous tab, select tab, new tab... * Zoom in, zoom out * ... many more! More features: * (NEW) Dictation mode for long-form text, auto scroll mode * (NEW) Add custom corrections, shortcuts, homophones or synonyms by clicking the transcript! x * 75+ default commands that can be expanded to infinity with additional plugins and tons of options * Multi-language support (Russian and Japanese in beta, other languages may be added by users) * 18 powerful default plugins: * Reddit * Google * Tabs and Windows * Text Input * Scrolling * Navigation * Gmail (BETA) * LipSurf * Timer * Weather * Dictionary * Wikipedia * Japanese<->English Dictionary * Hacker News * Anti-procrastination * Top Sites * Anki * WaniKani (Japanese Kanji Learning Tool) Please go through the tutorial to make sure you configure everything properly, and just say "help" to see the commands that are possible for the current page you're on! Enjoy! See more update info. along with video demos here: https://www.lipsurf.com/updates Recent Updates: 2019-8-25 * Now works on Evernote * Better Google Docs support. 2019-8-19 * Hugely improved Gmail integration (21 new commands) * New "keyboard" plugin for typing enter, tab, and individual letters for spelling * Performance improvements 2019-7-26 * New submit command! It's like hitting enter after typing in a form (eg. search boxes). * Fixed issue with resetting to factory defaults. * Fixed issue where new versions of plugins were not being fetched after 2.0. * Fixed over eagerness of stop command. * (PREM)Nice text for go to [URL] and accuracy improvements. * Fixed Google in Japanese. * (PREM)(BETA) Japanese dictation mode. 2019-7-19 Autoscroll saves last configured speed. Scrolling on PDFs now works. 2019-7-17 Import and export custom shortcuts/homophones. 2019-7-13 New way to click links (by saying "click [link name]" Improved dictation mode (PREM) Improved wake word 2019-5-25 Allow for multi-line custom shortcuts (try clicking the live text to add a custom shortcut) More accurate auto scrolling to posts in Reddit (Premium) Fixed dictate and dictation mode homophone issue. 2019-5-15 (Premium) Added undo (BETA) and redo (BETA) support to dictation mode. (Premium) Improved dictation mode and dictate. 2019-5-11 Fixed issue with live text and needs upgrade dialogue where they wouldn't show when LipSurf was restarted on the same page. 2019-5-6 Tutorial usability improvements. More Japanese homophones. Options show disabled plugins as faded in the sidebar. Better highlighting of valid commands in the live transcript. 2019-5-4 Fixed issue with being occasionally signed out when installed on multiple computers. Improved linking to options. 2019-4-30 More Japanese homophones. Keep context help closed if user closes it manually. Fixed issue where sometimes two context windows would show. Fixed issue with live text sometimes not appearing. Improved tutorial scrolling. Reduced size of the application. 2019-4-25 Fixed issue where tutorial was opening for old users. Overhauled tutorial. 2019-4-5 Performance improvements. Better tagging. Better dictation mode (Premium) Bug fixes when no tabs with urls are open. WaniKani contexts! 2019-3-21 Fixed issues with custom homophones dialog on Gmail. Improved custom homophones autocomplete. 2019-3-19 New pricing plan Fixed Gmail scrolling 2019-3-13 Now you can customize per-plugin settings! Change the default new tab page in the Tabs & Windows plugin! Added speed up and slow down as alternatives for auto-scrolling faster and slower, respectively. Fixed issue with push-to-talk key not turning off on key release. Fixed issue with dictation mode being hard to exit when on free version. Added more homophones. 2019-3-8 PRO Dictation mode improvements. 2019-3-7 PRO Dictation mode for long-form dictation. Introducing contexts! Certain commands are now only possible in a given context (eg. faster/slower commands are only valid if you're in the autoscroll context). Contexts are entered via commands: say autoscroll to enter the autoscroll context, dictation mode to enter the long form dictation context. Commands might be ignored in your context... In the dictation context all the normal commands are ignored and tab, space, new paragraph, new line, and exit dictation are added. In the autoscroll context nothing is ignored, only the faster/slower commands are added. To exit the autoscroll context, say stop or scroll manually. To exit the dictation context say exit dictation. NOTE: switching tabs will also exit a context. Better options page with sidebar for easier navigation. Split up Browser plugin into: Scrolling, TabsAndWindows, Media, Navigation, DictationPRO and LipSurf. Added weather in * as an alternative match pattern for the weather lookup command. Fixed tag and scrolling issues on DuckDuckGo.com. 2019-2-24 PRO Made wake-word even less sensitive. 2019-2-23 PRO Made wake-word less sensitive. 2019-2-22 Fixed issue with uh-oh page sometimes being opened after initial upgrade from v1.9.2 2019-2-20 PRO Added wake-word! (It's "grasshopper" for now). Added push-to-talk key! Configurable sound effects for LipSurf activation/deactivation in options. PRO Added many homophones for WaniKani. Stability enhancements. 2019-1-15 Fixed issue with Japanese word splitter. Fixed issues with live-text getting in the way of the page at times. Made it more clear that page that automatically opens after install is the LipSurf tutorial. 2019-1-12 Updates to make all WaniKani number items properly recognized. Fixed issues with homophones being expanded to infinity. Don't allow blank custom homophone transcript sources. 2019-1-10 Fixed issues with language switching for ja/en. New zoom in, zoom out and reset zoom commands! Fixed some issues with recognizing certain vocab/kanji with numbers in them. 2019-1-8 Fixed issues with loading local plugins. Thanks Pat! Infrastructural improvements 2019-1-6 Better microphone permission handling and troubleshooting in the tutorial and options. Fixed issue with fonts on Windows and macOS. More 🇷🇺 Russian translations and some fixes general language handling (including 🇯🇵 Japanese). Thank you @ulalasava! Fixed issues on smaller resolutions (eg. help being cut off). Fixed issue with custom shortcuts/homophones and synonyms metrics gathering. Warning in the tutorial for Chromium users about incompatiblity. (Install Google Chrome instead). 2018-12-30 Custom homophones/synonyms/shortcuts can now be added by clicking the live text! Quickly add a shortcut to do a Google ... query, or activate any other command of your choosing. Map simple words to things that are hard to dictate ...PRO (eg. email addresses, unpronounceable usernames, random sequences of characters, etc.) Correct any misheard transcriptions. Map commands to vocabulary that you have an easier time saying or remembering. New "feeling lucky" command let's you automatically go to the first result of a search query. Try feeling lucky Django documentation. Improved the tag command. 2018-12-20 Fixed bug where saying tag would cause high CPU usage. 2018-12-17 Completely rehauled the Japanese kanji➡kana conversion (new dictionary download is necessary). Big improvements to the WaniKaniPRO plugin Loading icon, and language displayed in the icon. Improved language switching speed. Improved subscription modification button 2018-12-11 Fixed issue that prevented sign-out and may have caused other authentication issues. 2018-12-5 Smarter deprecation logic depends on the user's previous version. 2018-12-5 Continuous deployment integration improvements. 2018-12-5 Fixed issue where Pro users would get repeat upgrade messages. Chained homophones in WaniKani PRO fix. Temporary WaniKani PRO fixes for certain characters. 2018-12-3 Hotfix to bug for brand new users in 1.6.4 2018-12-2 Testing new release automation. Important updates show as notifications. Better error handling. 2018-12-2 Better error handling. 2018-12-1 Fixed Japanese number to digit conversion. 2018-11-30 Hotfix: LipSurf wouldn't turn on with certain settings configurations. 2018-11-29 Added lessons capability for WaniKani PRO WaniKani PRO now shows fully correct answer in transcript even when transcript only fuzzy matched answer. Updates now hosted online instead of in-app. 2018-11-18 New dictionary command (try saying dictionary "exculpate"). New English ⬌ Japanese dictionary commands. Try saying Japanese lookup "jet lag" to lookup an English ➡ Japanese word. Switch to Japanese by saying Japanese then try saying じしょたこやき to lookup "takoyaki" a Japanese ➡ English word. New Wikipedia command (try saying wikipedia "John Perry"). Fixed bug with top part of page being un-clickable. Tip of the Update Remember you can say Japanese or えいご to switch between Japanese and back to English, respectively. 2018-11-16 Internal improvements to Pro version. Added privacy policy. 2018-11-7 Better bug/error tracking 2018-11-2 Commands in the middle of a transcript are now recognized (see video on the left)! Faster command recognition. New scroll right and scroll left commands. Smarter scroll commands look at viewport height. Thank you @aparajita! Live text stays on top of new tabs and pages. Tip of the Update Remember you can say options or right click the extension icon and click "options" to see and configure all the possible commands. 2018-10-16 New ANKI plugin! Sign-in and registration included in tutorial. Faster play video command. Go to r [subreddit name] is no longer global. Tutorial command. 2018-10-08 v1.0 and LipSurf Pro are finally here! New Commands PRO Dictate Text Quick text dictation by focusing on an input and saying dictate [text you want to input]. Great for search boxes, short comments, or messages! You can redo the dictation just by repeating the command. PRO Go to URL Go to any URL by saying go to [url]. You can also spell the URL if it's a really hard one. Even the rarer sites are now at your finger ti— err... the tip of your tongue! LipSurf now never starts as activated when Google Chrome opens (even if it was activated when the browser was shutdown last). Old annotate and unannotate command words added as alternatives to tag and untag respectively. 2018-09-26 Fixed error collection. 2018-09-26 Fixed issues with tutorial. 2018-09-26 New "Anti-Procrastination Plugin"! Try open Reddit for 10 seconds (you can say "open [any website] for [any duration]") Google calendar commands! Try add event to Google calendar or just Google calendar. Changed default shut off time from 20m to 5m. Fixed issue that would occur when many tabs were open (LipSurf wouldn't load). 2018-09-19 Infrastructure improvements. Added BETA Russian support! Added new window command. Added Hacker News plugin. Improved tutorial. Tip of the Update Now you can say tag and untag instead of annotate/unannotate, respectively. 2018-09-12 Improved annotations. Improved Reddit commands. Performance improvements. New Top Sites plugin. Try saying youtube! Improved Japanese recognition. New WaniKani plugin commands (more info, last 10) and added more homophones. Tip of the Update We now have a forum where you can make feature requests and ask questions: https://discuss.lipsurf.com 2018-09-06 Added "dev mode" and button to load local plugins. Make your own plugins. Improved core design. 2018-09-02 Hide updates for 0.7-0.7.1 to not annoy users with too many updates. 2018-09-02 Added more English dialects. Actually fixed issue with overlapping commands in WaniKani specifically. Language picker in first page of tutorial. 2018-08-31 Fixed issue with overlapping commands -- delaying commands that are partial matches of other commands. Fixed issue with command priority. Tip of the Update Try using a headset for improved transcript accuracy. Apple headphones work quite well! If you see 3 rings on your headphone jack (like in the picture), that means there's a microphone. 2018-08-13 Fixed issue where live text would show but commands would not be executed. Fixed issue where LipSurf would break after any network issue -- sometimes caused by saying many things while LipSurf is activated. Fixed issue with setting auto. off timer to 0 not working. Added English homophones: kay ➡ k, okay ➡ ok, are ➡ r, you ➡ u Fixed issue where toggling LipSurf on WaniKani would sometimes cause the wrong language to be selected. Fixed issue where LipSurf would stay on if it was shutdown while on a Japanese reading for WaniKani. Fixed issue with recognizing WaniKani vocab/kanji with numbers. Added many default homophones for WaniKani. esp. for Romaji ➡ Japanese. Fixed issue with apostrophes, hyphens in WaniKani answers. Tip of the Update Don't say "annotations off" say "turn off annotations" or "hide annotations" -- that way LipSurf doesn't jump the gun and think you're saying just "annotate". 2018-08-05 You can now spell out hard-for-the-recognizer words in WaniKani. If already in English mode (answering meanings) then just start spelling it out. If in Japanese mode, first say "えいご" then spell the reading as you would type it (eg. for しょうがつ say "s-h-o-u-g-a-t-s-u") Added commands to switch between Japanese and English. Fixed bugs with general Japanese and WaniKani. Tip of the Update You can spell out words if LipSurf is having trouble recognizing you. Try spelling out "g-o-o-g-l-e-l-i-p-s-u-r-f".

Latest reviews

  • (2019-11-28) Amol Verma: LipSurf was a lifesaver when I started having problems with repetitive strain injury in my arms and wrists. That problem's gone now, but LipSurf let me use the internet without pain for a while, and I'm really grateful for that.
  • (2019-11-02) Sp also: Wow! Everyone should have this. I will probably go Premium. looks like it is a great app.
  • (2019-09-26) Louis Swanepoel: Kings and Generals brought me here. I don't normally click on links in the description, but this I just had to.
  • (2019-09-14) Jessica DeVita: I had lipsurf up and running (paid version) within 5 - 10 minutes. It is amazing. It works in the chrome browser (not sure about other browsers) and Dragon never did. I have had 3 surgeries on each arm and wrist for cubital tunnel, tendinitis, carpal tunnel and can't type or mouse without pain. Thank you! My 8 year old is now also using this and loves it.
  • (2019-09-06) Shea C: I am extremely happy with this product it has been absolutely life-changing as I am dyslexic it helped me a great deal and with the support I have received has been amazing miko has gone above and beyond what I have asked I would happily recommend this to anyone thank you so much
  • (2019-08-24) michiaki yamada: I primarily use LipSurf for WaniKani, and it is well worth the monthly cost, as it makes using WK much easier if you are trying to avoid typing, and in some ways actually makes it better. But I've also used LipSurf for navigation and dictation, and it works very well. Compared to the big expensive competitors, which I have used recently as well, Lip Surf is just as good or better for use in-browser. They are very helpful and fast with support questions too.
  • (2019-07-31) Hr Gwea: It doesn't work on Chrome 49. You should add a minimum required version in your manifest.
  • (2019-07-26) jamiel hafiz: I have used LipSurf for 4 months now and is incredibly valuable for web-based work I have to do. It also makes browsing and emails much easier too. I chose Premium for features helpful for my work and at $6/month it is far cheaper and less cumbersome than Dragon for 2 years. I just had my 1st issue and Miko, the Developer, responded very courtesly and professionally within 15 min. Issue minimal, he got me a solution and then also put in a patch that may help recurrence. Highly recommend this product and company!
  • (2019-07-21) jenvet car: this is great. please add support to spanish too
  • (2019-06-27) June Bug: I think its pretty cool... Its like Google Assistant...
  • (2019-06-11) Amit Saroj: I told "Russian" it change all text to Russian language and no commands are working as I don't know Russian language and when I say "English" it is not switching back to English.
  • (2019-05-31) Steve Whitehead: I have been looking for a replacement for Dragon Naturally Speaking for my emails as Dragon has quite high processor overheads which affect the performance of my virtual machine. I have a custom vocabulary for work and asked Miko if he was able to help with this. He added a plugin for custom Homophones/Synonyms and it is just what I need. I've set it up so that it enters the symbols I need as well (double quote = "; single quote = '; hash sign = #; etc). The accuracy is really good and I'm saving tons of time writing emails without my VM slowing down. It seems that LipSurf is very light on overheads. Couldn't be happier right now - I've been looking for something like this for ages! Steve.
  • (2019-05-27) Dan Darkow: High quality speech to text software and wonderful developer who is wiling to develop for custom needs. Great alternative for Dragon Naturally Speaking as it is steadily losing quality and stability in Chrome. Definitely worth the investment and commitment to learn!
  • (2019-05-23) Samuel Anderson: Great product. I got it for Wanikani to do flash cards. It has save me so much time and increase the rate of words sticking in my head by saying them. It is also useful for surfing, I bring my laptop around the house while I do other things.
  • (2019-05-08) Sanchit: Loved the feature where you can enable microphone access!
  • (2019-05-07) Sacha Korban: microphone
  • (2019-02-14) Mobashir Hosain: i love it
  • (2018-12-31) Luke Yeo: Love it! It allows me to browse the web and switch between videos while both of my hands are occupied. I was thrilled as the developer was willing to take my suggestions and made the changes I needed!
  • (2018-10-09) Ben Lowe: Best Speech to Text recognition app I have found for chome browsing, and especially useful with WaniKani!
  • (2018-09-11) Mauricio Manattini: works nicely! When are you planning to add Spanish support? I'm planning to be a backer.
  • (2018-08-07) Adrienn Varn: Love it! Originally got it for WaniKani but it's great for other things as well. I can't wait for updates!
  • (2018-08-07) Lee Davies: This is going to be an excellent tool. At current stage, its good, but still a bit rough around the edges. The developer is actively developing this tool and is active on the WK forums and passionate about this tool. He always willing to help, listen, look at bugs and work on future features. 5/5
  • (2018-08-07) Davis Sorenson: Fantastic. I have always wanted something like this. The WaniKani plugin is especially appreciated. Yesterday I did dishes with my computer across the room while doing WaniKani reviews.
  • (2018-08-02) Stephanie P.: This is great :)
  • (2018-05-20) Mark Borys: Awesome extension! Once you get the hang of the commands you don't need to use a keyboard or mouse. Great for browsing Reddit! Tutorial was very helpful.

Latest issues

  • (2019-08-11, v:2.4.1) Dylan Lawless: which document app ???
    Hi there! could you please let me know which document app or software this will work with? Also it will be my daughter usingthis as she has dyslexia and has found it brilliant so far but wants to write stories. We have tried it on wordpad with no luck. many thanks
  • (2019-07-26, v:2.3.1) jamiel hafiz: LS on and activated, though Voice not registering
    I used it all day, everyday, and this morning it's just not working. . It “activates” when I click the button (red dot appears and “EN” appears) but no speech registers. I have closed browser window and reopened. I have checked the microphone which still works on my computer's integrated voice command. I tried no headphone mode and it’s not working I need help and can’t have downtime today. Please help troubleshoot ASAP. I sent an email if calling is faster. Thanks
  • (2019-07-25, v:2.2.0) Dave Sullivan: Gmail
    How do I use it to dictate emails in gmail
  • (2019-05-22, v:1.17.0) Angela Wanner: Custom Homosyns
    I was playing around with these setting up commands to open web pages since I have to do this frequently for work Finally figured out how to get it to do what I wanted but I noticed if I uncheck a box next to one it does not stay unchecked and also would be great if there was away to delete ones we no longer need or as in my case that we messed up when creating
  • (2019-04-06, v:1.14.0) Michal Sečanský: WaniKani helper window is reappearing again and again
    WaniKani helper window is reappearing again and again even after I closed it. Very annoying. Can you fix it please? Thank you.
  • (2018-11-25, v:1.5.0) Hark: LipSurf in Vivaldi Browser
    Hi, I have recently discovered Vivaldi as a decent alternative to Chrome, although I mostly use Firefox. I installed Lipsurf and it appears as normal, however it does not detect anything i say. I don´t know if its just because it does not have the permissions which i don´t really know how to change, or if its because I am using Vivaldi. Thanks Hark
  • (2018-11-05, v:1.2.0) Alexander Campbell: Can't access the tutorial
    Nothing happens after installation, if anything is supposed to happen at all to guide new users through configuration. I click the extension icon to enable voice control, and nothing. I right click to check the options, and the microphone permission seems to be active, but no verbal prompts work. On the same page, underneath a header titled Subscriptions, there's a continuous buffer. I can't seem to find any way to make the extension work, which is a shame, since I was excited to check it out.

Statistics

Installs
3,043
Category
Rating
4.8438 (32 votes)
Last update / version
2019-11-17 / 2.11.0

Links