Note: iOS 9 + Facebook users w/ trouble scrolling: #super sorry# we hope to fix it asap. In the meantime Chrome Mobile is a reach around
hot  /  reviews  /  videos  /  cblogs  /  qposts

Sony's eye tracking technology will be a game changer

12:10 PM on 03.20.2014 // Dale North

The coolest thing I've seen at GDC so far

Imagine never having to use the right analog stick to move a game's camera or reticle. Instead, you'd use your eyeballs to aim or move the camera -- simply look at what you want to shoot at or move to.  

This sounds like some dream for the future of gaming technology, but Sony has a working eye tracking demo at GDC this year. I had my doubts at first, but after having the infrared camera system calibrated to my eyes, I played Infamous: Second Son...

...with my eyes! 

In an after hours demonstration last night, I sat down with Sony Computer Entertainment software engineer Eric Larsen to check out eye tracking, not knowing what to expect. I wondered what the big deal was about a game tracking my eyeballs. Why would a game need to look at me when I'm looking at it?

Larsen had me sit in front of an infrared sensor and look at a screen to see a really creepy shot infrared of my own eyes, and then he had me follow a marker that moved around the screen to finish calibration. And that's all it took. 

From there, I was able to try out a demo stage of Infamous: Second Son that had been modified for eye tracking input. It looked exactly the same as the current PS4 release, but I noticed that when I looked around the screen, the camera followed. As you can imagine, this took a bit of getting used to. Having my eyes scanning the game's setting had the camera shifting left and right. It wasn't fast enough to be disorienting, but it was like someone had their thumb on the right analog stick, pushing it slightly to mess with me.

It only took a few seconds to get used to, and using the analog stick to compliment eye camera control became natural quickly. 

But when I turned the corner out of an alley, I immediately found myself under fire, and I had to quickly get used to aiming with my eyeballs. Again, scanning the screen to try to keep an eye on all the action wasn't helping, but as soon as I learned to focus my attention on one object on the screen, I only had to mash R2 on the controller to take anything out. Once it clicked, the feeling of power was overwhelming. After blowing away my first few enemies I was so excited by this ability that I almost jumped out of my seat!

I imagined that aiming and controlling the camera with my eyes would be tiring, but it felt completely natural. Just look and shoot. It almost felt like a mind power being able to focus on one object on the screen and have all my fire direct exactly on it. Picking off targets in the distance became really easy for me after a couple of minutes. But it wasn't too easy; the concentration required to target properly still had this control scheme feeling like a game, and as soon as that concentration broke, my aim faltered.

Larsen explained that this demonstration used currently available technology, and that their software was doing most of the heavy lifting. He said that one day they might be able to combine this eye tracking technology with their virtual reality technology to make for an even more immersive experience. 

Imagine being able to use eye tracking in a sports game. You could look at another player before passing the ball instead of having to choose a player with a controller button. A survival horror game could have you training a flashlight in the dark with your eyes. We came up with several great ideas like these during our chat.

For someone that plays games professionally, I'm a terrible aim. I'd love to see this come to market for this point alone! 

Let's hope that Sony continues to move forward with this exciting technology.

Dale North, Former Dtoid EIC
 Follow Blog + disclosure DaleNorth Tips
I am Destructoid's Editor-In-Chief. I love corgis. I make music. more   |   staff directory

 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our community fisters, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding * to your whitelists.

Status updates from C-bloggers

Amna Umen avatarAmna Umen
Mission complete![IMG][/IMG]
Serethyn avatarSerethyn
Black Friday slowly seems to creep its way onto Continental Europe, but I'm not complaining! I managed to get my grubby little paws on a new physical copy of The Wonderful 101 for €20! Thanks, America!
Archelon avatarArchelon
Community Question: Since I missed yesterday, I am going to do something a little different today. Are there any questions you would like to ask me for a change? If so, please feel free. I may add a second Community Question later today, as well.
RexterNathan avatarRexterNathan
Isn't PES 2016 Free-to-Play model just the demo with extra crap thrown in?
Fenriff avatarFenriff
Damn Gumo, you cold as fuck. [img][/img]
Atleastimhousebroken avatarAtleastimhousebroken
While partially responsible for one of the biggest jokes in the metal, Cold Lake by Celtic Frost, Curt Bryant is doing the soundtrack to the game Slain!. I'm digging the shitty garage band vibe.
LinkSlayer64 avatarLinkSlayer64
How is the Lightening thread STILL GETTING COMMENTS!?!?!? P.S. I am trying to make Chex Mix, but we lost my special recipe I custom designed. sucks man.
Torchman avatarTorchman
Got a deal on a Surface Pro 3 model that I wanted. Now I just need a deal on a PS TV in Canada and I'm golden.
FlanxLycanth avatarFlanxLycanth
If you in the UK, don't have a PS4 and don't mind buying used/display goods there's a few reconditioned PS4 (12 month warranty) on amazon for £199.
SirDavies avatarSirDavies
my dilemma this black friday is a PS4 for bloodborne and little else or like half the games on my steam wishlist. I know in my heart which one I'm going to pick.
El Dango avatarEl Dango
"You had all the lasagna you could ever eat, yet you kept going!" "This isn't about the lasagna anymore, Jon, and I didn't come this far just to quit! Tonight, I'm making sure my name will go down in history!"
Pixie The Fairy avatarPixie The Fairy
Got DeSu2 Break Record from GS' Black Friday sale ($29.99). Love the Arrange CD. It's been far too long since I heard Meguro do something that wasn't tied to Persona. Also grabbed an extra copy of Freedom Wars since they were $5.
Jed Whitaker avatarJed Whitaker
Haven't been around a few days. Getting over a cold and working on a review for Superbeat: Xonic on Vita. Starting to feel better, I think / hope.
inspavo avatarinspavo
Solar Pony Django avatarSolar Pony Django
So I'm almost done with my first play through of Undertale and... It's okay. It's in no way bad (and I'm enjoying it more than Fallout 4 which in also playing) but feel... It was overhyped I suppose? Not sure really... Maybe a second play though will help
Agent9 avatarAgent9
Sometimes I wonder why I care. To simply have more vitriol and misery as my reward, to suffer ingrates and fools. That in all I do I'm never afforded the same respect or kindness. Let it be then, and let pain follow. I'm done with this shit.
Mike Martin avatarMike Martin
I was telling this dead baby joke at dinner tonight, and this lady I don't recognize says, "I'm sorry. That joke isn't funny to me, I have two dead children." At this point, I went over my options in my head and settled with telling her the joke twice.
CoilWhine avatarCoilWhine
I really wish the slowpokes at Microsoft would add Forza Horizon to Xbox One backwards compatibility.... It's my favorite racing game. And the soundtrack is honestly flawless.
Parismio avatarParismio
Some green tea and Mario Kart w/ family is a great way to end the day.
KingSigy avatarKingSigy
Honestly, Broforce might be my GOTY. It's really fucking amazing.
more quickposts



Invert site colors

  Dark Theme
  Light Theme

Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo

Back to Top

We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -