Speech recognition is any means by which you can interface with your computer via spoken word. This page is designed to identify applications that can facilitate speech recognition and to serve as a guide in installing and using this software in Arch.
A note to newcomers: speech recognition is something that traditionally has not been well supported in Linux. If you become interested and choose to dig below the immediate surface, you can expect difficulty in finding documentation or help from the community.
Types of speech recognition
Speech recognition can mean several things:
- As it sounds, Text-To-Speech (or TTS) will manipulate a string of text into an audio clip. It is useful for blind people to be able to use computers but can also be used to simply improve computer experience. There are several programs available that perform TTS, some of which are command-line based (ideal for scripting) and others which provide a handy GUI.
- Simple Voice Control/Commands
- This is the most basic form of Speech-To-Text application. These are designed to recognize a small number of specific, typically one-word commands and then perform an action. This is often used as an alternative to an application launcher, allowing the user for instance to say the word “firefox” and have his OS open a new browser window.
- Full dictation/recognition
- Full dictation/recognition software allows the user to read full sentences or paragraphs and translates that data into text on the fly. This could be used, for instance, to dictate an entire letter into the window of an email client. In some cases, these types of applications need to be trained to your voice and can improve in accuracy the more they are used.
List of text to speech applications
The two major players in text-to-speech applications are Festival and eSpeak. Comparison available here
- eSpeak — Compact open source software speech synthesizer for English and other languages which currently supports more than 50 languages.
- Festival — General framework for building speech synthesis systems as well as including examples of various modules. As a whole it offers full text to speech.
- Gnome speech — API to incorporate speech into GNOME application menus
- MBROLA — Non-free phonemes-to-audio program which supports more than 70 languages.
- Speech Dispatcher — Common interface to speech synthesis. It has backends for eSpeak, Festival, and a few other speech synthesizers.
- Jovie — KDE Text To Speech Daemon.
List of voiced commands applications
VEDICS (Voice Enabled Desktop Interaction and Control System) is an assistive software which lets the user to interact with the OS using voice commands.
Note: Not yet tested
- Perform common window operations like close, minimize, maximize etc.
- Invoke default applications like browsers, mail clients etc.
- Access any element on the desktop just by saying its name.
- Supports GNOME3, GNOME2
Perlbox Voice is an voice enabled application to bring your desktop under your command.
- Last updated in 2005
- Package is in AUR, but missing festival-don dependency.
- Text to speech (Thanks to the Festival speech synthesizer)
- Voice control to open user specified applications. For example, if you say "Web", the Perlbox-Voice Control will open the browser of your choice.
- Desktop plugins to control your Linux desktop using only your voice. You can switch virtual screens, cycle through desktops, invoke the run dialog, quick lock the screen.
- Custom commands are fully supported, and you can add commands on the fly.
- Pseudo Commands' allow you to enter commands that the speaker should say. For example, if you say "Good morning", the computer voice could say "And good morning to you".
List of speech recognition applications
Free Speech Recognition Engines
- http://sourceforge.net/projects/speech2text/ - Simon is a QT interface to Julius that will replace the mouse and keyboard with your voice. Works with X11 and Windows
- Speech is a Chrome App for dictation, using Google's speech recognition engine.
- Julius is a large vocabulary continuous speech recognition decoder, their project page is located on http://julius.sourceforge.jp/en_index.php
- Uses ViaVoice to pass text to X applications. http://xvoice.sourceforge.net/
- wikipedia:IBM ViaVoice
- http://code.google.com/p/sphinxkeys/ - You can essentially type keyboard keys and mouse clicks by speaking into your microphone
- http://www.voxforge.org/ - a project that collects speech transcriptions for use in open source speech recognition engines
Proprietary Speech Recognition Engines
- Dragon Naturally Speaking in Wine
- Dragon Naturally Speaking software by Nuance is a well-functioning and popular implementation of speech dictation. It is developed for Windows, but has been run successfully in a a Linux enviornment using wine. It can be used independently for dictation into other wine programs such as notepad or it can be paired with Platypus to interface with any native linux program. Platypus also provides a feature to control of your OS using voice commands, similar to the programs described in #List of voiced commands applications.
- Nuance's software is non-free, so you will have to purchase a copy. Note that Dragon provides you with the ability to install it on a set number of machines.Installing/Reinstalling in wine may use up some of these licenses.
- Platypus Project
- Wizzscribe SI
- Verbio ASR
- DynaSpeak from SRI International
- LumenVox Speech Engine
- http://www.vocapia.com and Wikipedia
- VoxSigma is a speech-to-text software suite by Vocapia Research. It is well suited for broadcast monitoring, audio visual archive indexing, telephone speech analytics, transcription of business conference calls, and video subtitling.