How Did Stephen Hawking’s Communication System Work?

Stephen Hawking used a speech-generating device (SGD) or a voice output communication aid to talk through ‘the computer’. This is a special device that either supplements or replaces speech/writing for people who have problems communicating in a traditional way.

Stephen Hawking is a name that is impossible to ignore, especially if you are a human being on Earth. However, even aliens might know a thing or two about him.

To give you a quick background, he was a British cosmologist and physicist, best known for his remarkable scientific contributions to the theoretical prediction of radiation emission from black holes (Hawking radiation), Penrose-Hawking theorems, the general theory of relativity, and quantum mechanics. He also authored A Brief History of Time, a popular bestseller discussing the Big Bang and black holes.

In this article, I will explain how he talked using a special device.

Recommended Video for you:

Amyotrophic Lateral Sclerosis (ALS): Disease That Affected Hawking

Apart from these accomplishments, there’s one more and rather unfortunate thing that he was commonly known for: he had amyotrophic lateral sclerosis (ALS). Also referred to as motor neuron disease in some countries, it involves the death of neurons in a patient’s brain. It results in muscle twitching and gradually deteriorating muscles, leading to difficulty swallowing, speaking, and eventually breathing.

Stephen Hawking used various gadgets to give lectures and communicate with people, as he could not speak like most people due to his medical condition. You might have seen him in pictures or videos, sitting in a wheelchair with several machines attached.

Let’s take a closer look at these machines and how they helped Hawking share his knowledge and ideas with the world through his words.

Hawking’s Speech-Generating Device

Stephen Hawking used a speech-generating device (SGD) or a voice output communication aid to communicate. This device is designed to supplement or replace speech and writing for people who have difficulty communicating in a traditional way. 

Since 1997, Hawking had been using a computer-based communication system made by Intel Corporation. The entire computer system was replaced every two years to accommodate his gradual loss of muscle control over time. Hawking also wrote a short post titled ‘The Computer,’ briefly discussing the tools that helped him communicate. 

Intel has released Hawking’s speech system called Assistive Context-Aware Toolkit as open-source code for the general public to customize and improve the system to make it more suitable for a wider range of communicative disabilities.

Feeding The Information Into The Machine

Stephen Hawking’s communication system was made up of three major components. The most challenging element in his case was the input due to his lack of control over his muscles, which made it impossible to type out words or click buttons as he had been able to do when his condition was better initially. As a result, he needed a more sophisticated input method to feed information into the computer.

To solve this problem, an infrared switch was mounted on his spectacles, which could detect the slightest twitches or movements in his cheek. In the past, when his condition was better, he input information by pressing a clicker with his thumb.

However, as he eventually lost control of the nerves that controlled his thumb muscles, he had to use other input methods, hence the infrared switch that traced movements in his cheek.

Interface

The next part involved forming words using the input from the infrared switch. This interface is a program called EZ Keys, developed by Words Plus Inc. It provided a software keyboard that was displayed on a tablet computer and mounted on one arm of his wheelchair, which was powered by the wheelchair batteries.

The software moved a cursor across the keyboard by either moving through columns or rows. When it reached the desired word, Hawking could stop it with a twitch of his cheek. Individual letters were selected in this way to form words and then sentences. Furthermore, EZ Keys also let him move the pointer in the Windows computer that he used.

To make things easier still, the software also included an auto-complete feature – very similar to what we have in smartphones and tablets – that predicts the word without requiring Hawking to complete the spelling of the entire word.

Output: Talking Out Loud

The final step, probably the easiest, involved speaking the entire sentence out loud. To accomplish this, Hawking used a speech synthesizer developed by Speech+ that would speak the sentence once it was approved or completed. However, it had a recognizable accent that was described as American, Scottish, or Scandinavian.

The machine allowed him to speak and perform various other tasks, such as checking his email, browsing the internet, making notes, and using Skype to chat with his friends. Intel had a dedicated team of engineers working on improving his communication system and expanding the range of tasks he could perform. Hawking could give lectures and interact with people with ease using this communication system.