Apple Announces New AI and ML Powered Eye Tracking and Music Haptics Accessibility Features 142s6w Technology News

Apple is bringing these features for both the iPhone and the iPad. 1y6f40

Written by Siddharth Suvarna | Updated: 16 May 2024 17:40 IST

Apple Announces New AI and ML Powered Eye Tracking and Music Haptics Accessibility Features

Photo Credit: Apple 62m2c

Apple Vision Pro will also get a system-wide live captions feature to help those with hearing impairments

Highlights

A Vocal Shortcuts feature will let s perform tasks with custom sound
Apple is adding vehicle motion cues to help s with motion sickness
Apple CarPlay is also getting a voice control feature

ment

iPhone and iPad devices on Wednesday. The company regularly introduces new accessibility features to make the devices easier to use for those who suffer from physical disabilities. This year, the tech giant is bringing a new Eye Tracking feature that will allow s to control their device with just eye movements. Additionally, Music Haptics will let s experience music via vibrations, and Vocal Shortcuts will let them perform tasks with custom sounds.

The features were announced via a post on the company's newsroom. Apple's senior director of Global Accessibility Policy and Initiatives, Sarah Herrlinger said, “Each year, we break new ground when it comes to accessibility. These new features will make an impact in the lives of a wide range of s, providing new ways to communicate, control their devices, and move through the world.”

First, the Eye Tracking feature offers s a built-in option for operating iPhone and artificial intelligence (AI), this feature uses the front camera which can be calibrated with the 's eyes and the on-device machine learning (ML) features track the eyes to let people with physical disabilities easily navigate through the phone. The company says that it does not have the access to the data.

iPhone 16 Pro Max Spotted in Leaked Images, Could Be Larger This Year

Music Haptics is another new feature that offers a unique way for s to experience music who suffer from hearing impairments. The feature, on iPhone, leverages the Taptic Engine to play taps, textures and vibrations to match the audio of the music. Apple says the feature can play millions of songs in the Apple Music catalogue. It will also be available as an API for developers to integrate it in their music apps.

Next, Vocal Shortcuts for iPhone and iPad s is designed to help people suffering from speech-related disabilities. It allows s to set custom utterances that can be understood by Siri to launch shortcuts and complete tasks. Further, a new feature dubbed Vehicle Motion Cues adds animated dots on the edges of the screen to reduce sensory conflict between what a person sees and feels. Citing research, Apple said this conflict is one of the main reasons behind motion sickness, and the feature can reduce such symptoms.

Apart from these, CarPlay is also getting voice control, sound recognition, and colour filters to help s with various disabilities. Apple's newest product line, Vision Pro is also getting a system-wide live caption feature for those with hearing difficulties.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

links may be automatically generated - see our ethics statement for details.

Comments

For the latest reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Artificial Intelligence

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen ing his favourite football club - Chelsea, watching movies and anime, and sharing ionate opinions on food. More