hot  /  reviews  /  videos  /  cblogs  /  qposts

Sony's eye tracking technology will be a game changer

12:10 PM on 03.20.2014 // Dale North

The coolest thing I've seen at GDC so far

Imagine never having to use the right analog stick to move a game's camera or reticle. Instead, you'd use your eyeballs to aim or move the camera -- simply look at what you want to shoot at or move to.  

This sounds like some dream for the future of gaming technology, but Sony has a working eye tracking demo at GDC this year. I had my doubts at first, but after having the infrared camera system calibrated to my eyes, I played Infamous: Second Son...

...with my eyes! 

In an after hours demonstration last night, I sat down with Sony Computer Entertainment software engineer Eric Larsen to check out eye tracking, not knowing what to expect. I wondered what the big deal was about a game tracking my eyeballs. Why would a game need to look at me when I'm looking at it?

Larsen had me sit in front of an infrared sensor and look at a screen to see a really creepy shot infrared of my own eyes, and then he had me follow a marker that moved around the screen to finish calibration. And that's all it took. 

From there, I was able to try out a demo stage of Infamous: Second Son that had been modified for eye tracking input. It looked exactly the same as the current PS4 release, but I noticed that when I looked around the screen, the camera followed. As you can imagine, this took a bit of getting used to. Having my eyes scanning the game's setting had the camera shifting left and right. It wasn't fast enough to be disorienting, but it was like someone had their thumb on the right analog stick, pushing it slightly to mess with me.

It only took a few seconds to get used to, and using the analog stick to compliment eye camera control became natural quickly. 

But when I turned the corner out of an alley, I immediately found myself under fire, and I had to quickly get used to aiming with my eyeballs. Again, scanning the screen to try to keep an eye on all the action wasn't helping, but as soon as I learned to focus my attention on one object on the screen, I only had to mash R2 on the controller to take anything out. Once it clicked, the feeling of power was overwhelming. After blowing away my first few enemies I was so excited by this ability that I almost jumped out of my seat!

I imagined that aiming and controlling the camera with my eyes would be tiring, but it felt completely natural. Just look and shoot. It almost felt like a mind power being able to focus on one object on the screen and have all my fire direct exactly on it. Picking off targets in the distance became really easy for me after a couple of minutes. But it wasn't too easy; the concentration required to target properly still had this control scheme feeling like a game, and as soon as that concentration broke, my aim faltered.

Larsen explained that this demonstration used currently available technology, and that their software was doing most of the heavy lifting. He said that one day they might be able to combine this eye tracking technology with their virtual reality technology to make for an even more immersive experience. 

Imagine being able to use eye tracking in a sports game. You could look at another player before passing the ball instead of having to choose a player with a controller button. A survival horror game could have you training a flashlight in the dark with your eyes. We came up with several great ideas like these during our chat.

For someone that plays games professionally, I'm a terrible aim. I'd love to see this come to market for this point alone! 

Let's hope that Sony continues to move forward with this exciting technology.

Dale North, Former Dtoid EIC
 Follow Blog + disclosure DaleNorth Tips
I am Destructoid's Editor-In-Chief. I love corgis. I make music. more   |   staff directory

 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our moderators, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding * to your whitelists.

Status updates from C-bloggers

Pixie The Fairy avatarPixie The Fairy
A Nintendo rep gave this to me today because she likes talking to me. I do have lots of the Old AC eReader cards I guess I could put in it... [img][/img]
GoofierBrute avatarGoofierBrute
I'm still trying to figure out how to do it, but for the most part I like what I've seen of the new blog editor. My first blog post using it should go up tomorrow.
Pixie The Fairy avatarPixie The Fairy
The demon threat is real.[img][/img]
Mike Martin avatarMike Martin
RadicalYoseph avatarRadicalYoseph
Daily VGM #20 (Bonus) - Valak Mountain Night (Xenoblade Chronicles) [youtube][/youtube] This theme perfectly captures the essence of Valak Mountain. It feel serene and calm, as well as mountain-esque (lol).
Lawman avatarLawman
What does one do when MGS V has lost its luster and Persona 4: DAN is growing stale? Listen to Queens of the Stone Age, of course. And wonder; is Steins;Gate worth the asking price? I want it, but not sure if I $30 - $40 want it...
Terry 309 avatarTerry 309
Been trying to get Tales Of Phantasia finished before Zestiria comes out... How i'm going to get through that game I have no clue... especially when Exist Archive comes out in December and I have to play that too... also i've still yet to finish Grandia 2
TheLimoMaker avatarTheLimoMaker
Been in a bit of a rut this week and as such haven't really been satisfied with any of my games. Therefore, I'm going to start Destiny again on my new PS+ account. Any tips given the amount of updates it's had?
Bardley avatarBardley
Bought a used knockoff game console called the Power Kracker 2013, which claimed to have 76,000 games. The AC adapter was missing and someone had crammed an off-brand GameCube controller inside the box. I don't know what I expected.
Firuzi Gafrindashvili avatarFiruzi Gafrindashvili
Resident Evil: Revelations 2
RadicalYoseph avatarRadicalYoseph
I actually love the quests in Novigrad where you write a play. It's a fun and lighthearted break from the tragedy of Baron and horror of Velen and the Crones.
FlanxLycanth avatarFlanxLycanth
I preordered Tales of Zestria and Disgaea 5 because they were £10 cheaper that way, WHO WANTS TO FIGHT ME HUH?
Gamemaniac3434 avatarGamemaniac3434
Man, plague of shadows is gooood. It really fleshes out plague knight and the world by extension, and it has some fun story stuff. Plus plague knight plays differently enough to shovel knight to make whats old feel new again. Deep customization too.
nanashi avatarnanashi
You will be missed. 2001 - 2015 ATHF RIP. ... oh and uh, GET OUT OF MY FREAKING POOL!!
SpielerDad avatarSpielerDad
Freezing my ass off at a Penn State football game. Half of the hicks at this stadium probably didn't graduate high school, yet they're rooting for a college football team. I wish I was on my warm den playing MGS V.
AvtrSpirit avatarAvtrSpirit
Gosh darn it, she's done it again! That Sapphire's a talented minx. [youtube][/youtube]
ChrisHannard avatarChrisHannard
Is renting games still a thing in America? I know there's only one UK company still doing rentals. And does it make you less tolerant of games? I definitely gave games less of a chance when I knew I could sling them back in the envelope and get a new one.
Termadoyle avatarTermadoyle
Probably the most awesome soundtrack in an indie game. And the game isn't so bad either. win/win situation tbqh.
Gamemaniac3434 avatarGamemaniac3434
"I musta dreamed a thousand dreams, been haunted by a millioon screaams, but I can hear the marching of feet, moving into the streeet!!!" Gosh dang this song is stuck in my head something fierce. Plus, puppets!
ShadeOfLight avatarShadeOfLight
PSA: Today is the last day you can submit characters for the Smash Bros. ballot. Help us nominate Bayonetta! [img][/img]
more quickposts



Invert site colors

  Dark Theme
  Light Theme

Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo

Back to Top

We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -