Wow! New technology may let you control smartphones with your eyes

Boston: Scientists, including one of Indian origin, are developing a new mobile software that can accurately identify where a person is looking in real time, an advance that may lead smartphones, tablets and other mobile devices to be controlled by eye movements.

In an effort to make eye tracking cheap, compact and accurate enough to be included in smartphones, researchers are crowdsourcing the collection of gaze information and using it to teach mobile software how to figure out where a person is looking in.

The researchers at Max Planck Institute for Informatics in Germany, Massachusetts Institute of Technology (MIT) and University of Georgia in the US, have so far been able to train software to identify where a person is looking with an accuracy of about a centimetre on a mobile phone and 1.7 centimetres on a tablet.

"It's still not exact enough to use for consumer applications," said Aditya Khosla, a graduate student at MIT.

However, he believes the system's accuracy will improve with more data.

The technology has been expensive and has required hardware that has made it tricky to add the capability to gadgets like phones and tablets.

It could make eye tracking a lot more widespread and also be helpful as a way to let you play games or navigate your smartphone without having to tap or swipe.

The researchers started out by building an app called GazeCapture that gathered data about how people look at their phones in different environments outside the confines of a lab, 'MIT Technology Review'

Users' gaze was recorded with the phone's front camera as they were shown pulsating dots on a smartphone screen. To make sure they were paying attention, they were then shown a dot with an "L" or "R" inside it, and they had to tap the left or ride side of the screen in response.

GazeCapture information was then used to train software called iTracker. The handset's camera captures your face, and the software considers factors like the position and direction of your head and eyes to figure out where your gaze is focused on the screen.

"About 1,500 people have used the GazeCapture app so far," Khosla said, adding that if the researchers can get data from 10,000 people they will be able to reduce the software's error rate to half a centimetre, which should be good enough for a range of eye-tracking applications.