hot  /  reviews  /  videos  /  cblogs  /  qposts

Sony's eye tracking technology will be a game changer

12:10 PM on 03.20.2014 // Dale North
  @DaleNorth

The coolest thing I've seen at GDC so far

Imagine never having to use the right analog stick to move a game's camera or reticle. Instead, you'd use your eyeballs to aim or move the camera -- simply look at what you want to shoot at or move to.  

This sounds like some dream for the future of gaming technology, but Sony has a working eye tracking demo at GDC this year. I had my doubts at first, but after having the infrared camera system calibrated to my eyes, I played Infamous: Second Son...

...with my eyes! 

In an after hours demonstration last night, I sat down with Sony Computer Entertainment software engineer Eric Larsen to check out eye tracking, not knowing what to expect. I wondered what the big deal was about a game tracking my eyeballs. Why would a game need to look at me when I'm looking at it?

Larsen had me sit in front of an infrared sensor and look at a screen to see a really creepy shot infrared of my own eyes, and then he had me follow a marker that moved around the screen to finish calibration. And that's all it took. 

From there, I was able to try out a demo stage of Infamous: Second Son that had been modified for eye tracking input. It looked exactly the same as the current PS4 release, but I noticed that when I looked around the screen, the camera followed. As you can imagine, this took a bit of getting used to. Having my eyes scanning the game's setting had the camera shifting left and right. It wasn't fast enough to be disorienting, but it was like someone had their thumb on the right analog stick, pushing it slightly to mess with me.

It only took a few seconds to get used to, and using the analog stick to compliment eye camera control became natural quickly. 

But when I turned the corner out of an alley, I immediately found myself under fire, and I had to quickly get used to aiming with my eyeballs. Again, scanning the screen to try to keep an eye on all the action wasn't helping, but as soon as I learned to focus my attention on one object on the screen, I only had to mash R2 on the controller to take anything out. Once it clicked, the feeling of power was overwhelming. After blowing away my first few enemies I was so excited by this ability that I almost jumped out of my seat!

I imagined that aiming and controlling the camera with my eyes would be tiring, but it felt completely natural. Just look and shoot. It almost felt like a mind power being able to focus on one object on the screen and have all my fire direct exactly on it. Picking off targets in the distance became really easy for me after a couple of minutes. But it wasn't too easy; the concentration required to target properly still had this control scheme feeling like a game, and as soon as that concentration broke, my aim faltered.

Larsen explained that this demonstration used currently available technology, and that their software was doing most of the heavy lifting. He said that one day they might be able to combine this eye tracking technology with their virtual reality technology to make for an even more immersive experience. 

Imagine being able to use eye tracking in a sports game. You could look at another player before passing the ball instead of having to choose a player with a controller button. A survival horror game could have you training a flashlight in the dark with your eyes. We came up with several great ideas like these during our chat.

For someone that plays games professionally, I'm a terrible aim. I'd love to see this come to market for this point alone! 

Let's hope that Sony continues to move forward with this exciting technology.



Dale North, Former Dtoid EIC
 Follow Blog + disclosure DaleNorth Tips
I am Destructoid's Editor-In-Chief. I love corgis. I make music. more   |   staff directory



 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our moderators, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding *.disqus.com to your whitelists.

 Quickposts
Status updates from C-bloggers

OverlordZetta avatarOverlordZetta
Oh neat, Hollow Knight got through the Colosseum of Fools stretch goal while no one was looking. Shame they couldn't get to three characters but the game still looks awesome.
techsupport avatartechsupport
S Rank is so satisfying. Too bad I rarely earn it!
Bardley avatarBardley
My MGSV: The Phantom Pain playthrough has quickly devolved into a journey to fill out Big Boss' 80's synth pop collection. And I couldn't be happier.
Dinosir avatarDinosir
You know what I love? Game tgat force you to connect to their servers even though you only want to play single player. Then the servers are down an the game tries for like 5 minutes, not even giving you a way to cancel the process, you just have to wait
Pixie The Fairy avatarPixie The Fairy
In today's Spelunky daily challenge, I was nibbled by a bat that pushed me into a Tiki trap that landed me dead on Kali's alter. Kali was pleased with the bat's sacrifice.
Shinta avatarShinta
It's pretty good guys ... [youtube]https://youtu.be/_98VZT9s7M0[/youtube]
Shinta avatarShinta
FFXV is supposedly 10x as big as The Witcher 3. Wow ... [img]http://i.imgur.com/9tfSuxQ.png[/img] http://www.dualshockers.com/2015/09/01/final-fantasy-xv-map-size-potentially-revealed-its-roughly-an-enormous-780-square-miles/
RadicalYoseph avatarRadicalYoseph
The ending of "Return to Crookback Bog" in TW3 I got was so depressing. Wow. I think I need a break...
Shinta avatarShinta
I'm sitting here play Metal Gear V, absolutely loving it. But in the back of my mind ... all I can think about is Mario Maker. I'm really excited for that game!
Patrick Hancock avatarPatrick Hancock
Sold a digital item on Steam, that came with a physical item, for more than the cost of the physical item. This is the second time I've done this. ¯\_(ツ)_/¯
GoofierBrute avatarGoofierBrute
Everyone right now is playing Metal Gear Solid V: The Phantom Pain. And here I am, waiting for Super Mario Maker to come out. And also Star Fox Zero.
Mike Martin avatarMike Martin
Patrick Hancock hates babies. Rick and Morty.... I wish I could view thee second season. I need to play MGSV. I spray farted earlier.
IDrawOnTape avatarIDrawOnTape
my wife and i got into Rick and Morty the same time we got into Gravity Falls. Man, some good cartoons out right now.
El Dango avatarEl Dango
Rick and Morty is like reverse Archer. Instead of everyone being insanely quick-witted, everyone stutters, pauses and repeats themselves a lot.
MeanderBot avatarMeanderBot
Drew a preeeeeeety sweet thing for the August edition of Cblog Recaps. Keep an eye out for it!
Cosmonstropolis avatarCosmonstropolis
No spoilers or anything, but the MGS V troll is amazing. I went from concerned to laughter in a matter of minutes.
VeryImportantQuestion avatarVeryImportantQuestion
Not saying that the "augment your pre-order" announcement caused me to fall ill, but the timing seems like too much of a coincidence.
IDrawOnTape avatarIDrawOnTape
Costco. 3 pack 18" dolls First order trooper, tie pilot, vader or Kylo for final one, I forget 44.99 September 4th, son.
epmpt avatarepmpt
Contact address: El Paso Manual Physical Therapy, 12135 Esther Lama Dr., Suite 1100, El Paso, TX 79936, Phone: (915) 252-5012, Email: [email protected]
TheAngriestCarp avatarTheAngriestCarp
Stealth in Payday 2 gets infinitely easier once you get the Control Freak perk.
more quickposts


Contest!


Seriously

Invert site colors

  Dark Theme
  Light Theme


Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo



Back to Top


We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -