Samsung has created smart TV software you can control with your brainwaves.
The research, called Project Pontis, aims to make Samsung’s televisions more accessible for people with physical disabilities like quadriplegia. The company wants to enable “users with physical limitations to change channels and adjust sound volume with their brains.”
Samsung’s Swiss operations started the project three months ago in partnership with the Center of Neuroprosthetics of the Ecole Polytechnique Fédérale de Lausanne (EPFL) in Switzerland. The company demoed its second prototype TV on Thursday at its developer conference in San Francisco.
“How can we provide accessibility to people who cannot move or who have extreme limitations on their movements,” Ricardo Chavarriaga, a senior scientist at EPFL who’s working on the project with Samsung, said during a panel at Samsung Developer Conference.
“We’re making tech that is more complex, that is more intelligent, but we should not forget this tech is being made to interface with humans,” he added.
The first step in making the brainwave-controlled TV software is to collect a sample of how the brain behaves when the user wants to do something like select a movie. Samsung and EPFL combine indicators from both the environment and brain scans to build a model and apply machine learning to let the user select shows using eye movements and brainwaves.
To collect the brainwaves in the prototype, a user wears a headset covered with 64 sensors while looking at an eye tracker. The headset is connected to a computer that’s mirrored to the TV.
The current prototype uses eye tracking to determine when a user has selected a particular movie. The system then builds a profile of videos the user gravitates toward, making it easier to provide lists of content in the future. The user ultimately makes a selection using eye tracking.