By KENTA NAKAMURA/ Staff Writer
August 17, 2023 at 18:57 JST
The system named Cotopat converts a speaker’s voice into text in real time and displays it on a transparent screen. (Provided by Kyocera Document Solutions Japan Inc.)
A transparent screen launched on Aug. 17 for local governments and companies will help foreign tourists and those hard of hearing "talk" with staff without resorting to smartphone apps or other devices.
The Cotopat system converts speech into on-screen text in real time or translates Japanese into five languages to assist the public, including English and Chinese.
It was developed by electronics manufacturer Kyocera Corp.
The screens are expected to be utilized at municipal government offices and train stations to assist those with hearing difficulties, including the elderly, and foreign travelers in understanding explanations offered at service counters.
The system recognizes the voice of a counter staffer through a microphone and uses artificial intelligence to translate the words and show them on the screen.
The text is projected onto a transparent screen, measuring 18 centimeters in height and 30 cm in width, which is attached to materials such as an acrylic board. The words are displayed in an easy-to-read fashion for viewers.
Preliminary tests showed that the speech recognition accuracy was 96 percent.
When using smartphone transcription apps, people tend to look down at their devices.
Cotopat makes it easier to see facial expressions and the mouth movements of counter staff, leading to more natural communication, Kyocera said.
Trials have been conducted at 17 facilities across the country, including JR Shinjuku Station and the Kamakura City Library.
Kyocera received feedback from users such as, “We can respond to those with hearing difficulties without raising our voices” and “Having text display made conversations easier, even for those without hearing issues.”
If the names of places or products are pre-entered in the system, Cotopat can automatically highlight these words or display related maps or images when they are mentioned in conversations.
Seibu Railway to test screen that translates 12 languages
July 6, 2023
Lawson adds new convenience for those who are hard of hearing
September 27, 2022
Interpreter from Vietnam calls for end to ‘flawed’ trainee program
November 12, 2022
Multilingual tour guides struggle as pandemic upends industry
March 7, 2022
A peek through the music industry’s curtain at the producers who harnessed social media to help their idols go global.
A series based on diplomatic documents declassified by Japan’s Foreign Ministry
Here is a collection of first-hand accounts by “hibakusha” atomic bomb survivors.
Cooking experts, chefs and others involved in the field of food introduce their special recipes intertwined with their paths in life.
A series about Japanese-Americans and their memories of World War II
