Summary

• Sony is developing software for VR gaming that detects sign language, offering more accessibility options.
• Multiple Sony patents reveal ongoing efforts to improve gaming accessibility, including this new VR tech.
• The system would allow hearing-impaired players to communicate with teammates through sign language translated into text.

A recent patent publication revealed a unique software in development by Sony that would allow for sign language to be detected and used in virtual reality gaming. Various insights into the research and development efforts by Sony in recent years have shown a major focus on improving accessibility features in gaming in tandem with a key focus on updates to VR gaming, and this latest patent looks to bring the two elements together in a way that could majorly benefit gamers.

Multiple hardware and software patents by Sony have given audiences a look behind the curtain at the Japanese technology company, with an impressive variety of innovations reaching the document publication stage. While a majority of these developments remain unreleased to the public, they do give players an idea of what could potentially be coming to consumers in the future, including this new VR tech focused on hearing-impaired players.

According to a patent published on October 10, Sony is working on a system that would allow players to use sign language in virtual reality gaming sessions. The technology would detect when a player is signing and would translate the signed communication into both text and a sign language avatar. This would allow hearing-impaired users to communicate with fellow players in VR games by simply signing and having their comments translated into text for their teammates to read. The system would also be able to convert voice communications into text or into sign language with the use of an avatar interpreter that would be displayed on the screen of the hearing-impaired player. Similar to other accessibility patents by Sony, this technology would allow more users to enjoy multiplayer gaming, though there is currently no guarantee that this system will be fully developed and released to the public.

Sony Virtual Reality Sign Language Software

Looking at Figures 1 and 5 of the Sony virtual reality sign language software patent, audiences can see how this system would work in practice. Two players would be able to communicate with one another via sign language and text, including translation across multiple languages. Figure 3 shows American Sign Language being converted to English text that is then translated to Japanese text which is finally converted to Japanese Sign Language. Hearing-impaired players from across the globe would be able to communicate with one another in virtual reality games, making VR much more accessible. However, as is true with other Sony technology patents, fans should always await official announcements before getting too excited by these patents.

With more companies prioritizing accessibility in video games, it should come as no surprise that Sony has filed a number of patents focusing on both software and hardware innovations to make gaming more welcoming to all kinds of players. It is always key to note that Sony and other companies frequently file patents that are never fully developed, so interested fans will want to stay tuned for any official updates regarding the VR sign language software and other promising developments.