Apple made a surprising announcement this week, unveiling a range of new accessibility features that are set to be released later this year, likely with the upcoming iOS 18 update. These features are powered by AI and machine learning technology and are designed to cater to users with various disabilities, enhancing their overall experience with Apple devices.
One of the standout features is Eye Tracking, which allows iPhone and iPad users to control their devices using just their eyes. By utilizing the front camera on the devices, users can navigate apps, engage with elements, and even mimic physical gestures with their eye movements, all without the need for additional hardware.
For users who are deaf or hard of hearing, Apple introduced Music Haptics, a feature that uses the Taptic Engine to play taps and vibrations in sync with the beat of a song. This not only serves as an accessibility tool but also enhances the overall music listening experience for all users. Moreover, Apple has made this feature available as an API for developers to incorporate into their apps.
Another new addition is Vocal Shortcuts, which allows users to assign actions to specific words or phrases. This feature, along with Listen for Atypical Speech, which adapts to users’ speech patterns, is particularly beneficial for individuals with conditions like cerebral palsy, ALS, or stroke that affect speech.
Additionally, Apple is addressing motion sickness with Vehicle Motion Cues, which places dots on the screen to counter the effects of motion sickness when users are in a moving vehicle. The company has also introduced new accessibility features for CarPlay, including Voice Control, Color Filters, and Sound Recognition.
Furthermore, Apple is enhancing its visionOS accessibility features with Live Captions, Reduce Transparency, Smart Invert, and support for hearing devices. VoiceOver is getting new voices and customizable controls, while the Magnifier app is receiving new features like Reader Mode and enhanced Detection Mode.
In terms of Braille features, Apple is introducing new functionalities for Braille Screen Input, multi-line braille support, and customizable input/output tables. Hover Typing, Personal Voice replication, and virtual trackpad capabilities through AssistiveTouch are among the other accessibility enhancements users can expect.
These new accessibility features from Apple demonstrate the company’s commitment to inclusivity and innovation, catering to a diverse range of user needs. With the incorporation of AI and machine learning technologies, Apple is setting a new standard for accessibility in mobile and computer devices.