Quantcast
Destructoid Japanator Tomopop Flixist
Dtoid Forums now support TapATalk and ForumRunner on your iOS/Android devices. Whoot.

Kinect will recognize sign language photo

That's pretty freaking cool. The only sign I know is what friends have taught me. I know diarrhea and some sex ones. Actually, I know a lot of the offensive ones.

A recently published patent confirms that Microsoft's Kinect will be able to read ASL (American Sign Language). And, if you suck at signing, you can just talk and it can read lips. How cool is that?

The best part is this section of the patent description, which basically says you can taunt in-game, via sign:

...for example, when the user kills another user's character, that victorious, though speechless, user would be able to tell the other user that he had been 'PWNED'. In another embodiment, a user may be able to speak or make the facial motions corresponding to speaking words. The system may then parse those facial motions to determine the user's intended words and process them according to the context under which they were inputted to the system.

I don't know any deaf people, but I'd bet they're pretty jazzed about this functionality. It basically adds voice chat in game for the deaf. The patent says " Under the present system, he could make ASL gestures to convey his thoughts, which would then be transmitted to the other users for auditory display. The user's input could be converted to voice locally, or by each remote computer."

How do you sign that this is good news? Two thumbs up?

Kinect Will Recognise Sign Language [Edge]








More gaming stories around the web. Got news? Submit yours to tips@destructoid.com

Dale North is Destructoid's Editor-In-Chief, a founding editor, and specialist in Japanese gaming. An accomplished musician, Dale was reporting from Japan during the earthquakes of 2011. Luckily, he got the fuck out alive and is home in America now with his wife and beloved corgi, Einstein. Dale is also a co-founder of Destructoid's sister anime site Japanator. Likes Corgis, Sega Saturn, PSP, iPhone, Photographic tools. Meet the rest of the team



Post a comment! You can also post a photo below:

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

39 comments | showing # 1 to 39
prev next

Sentry's Avatar - Comment posted on 08/06/2010 12:17
Sentry
That's actually pretty freakin' schway.
SPNKr's Avatar - Comment posted on 08/06/2010 12:18
SPNKr
Wow Kinect now actually has a purpose. Pretty neat idea I am interested to see how well it will work.
danthuman's Avatar - Comment posted on 08/06/2010 12:19
danthuman
So, there was another article talking about the tech, and the kinect doesnt pick up fingers. Doesn't ASL use fingers? I wonder how that works.
Spykron's Avatar - Comment posted on 08/06/2010 12:19
Spykron
cool, i shoot the bird at my games all the time anyway!
Minios's Avatar - Comment posted on 08/06/2010 12:21
Minios
So Kinect isn't for the senseless as Jim Sterling loves to say?
Jaku Omanga's Avatar - Comment posted on 08/06/2010 12:21
Jaku Omanga
SO DOESSS THAT MEANS WE CAN SAY F*** YOU WITHOUT SAYING IT !!!
GREAT ! !!
Mr Andy Dixon's Avatar - Comment posted on 08/06/2010 12:24
Mr Andy Dixon
Like Britney, I only know one sign:



Still, this is way cool!
Jaku Omanga's Avatar - Comment posted on 08/06/2010 12:28
Jaku Omanga
Lets flood this article with Britney's sign !
Nevi's Avatar - Comment posted on 08/06/2010 12:28
Nevi
Will doing got your nose make the 360 shit itself in panic and RROD?

mix's Avatar - Comment posted on 08/06/2010 12:29
mix
Now *Tane I can get into!

*That

Pretty cool little feature but not game changing as people will stillo try to T-bag eachother.
MooImaChicken's Avatar - Comment posted on 08/06/2010 12:29
MooImaChicken
this actually sounds interesting? and useful?... nah sounds too good to be true, wont believe it until I see it working.
Popyman's Avatar - Comment posted on 08/06/2010 12:30
Popyman
That's really neat, I'll admit. Isn't the new Half-Life going to have sign language?
watermanx's Avatar - Comment posted on 08/06/2010 12:30
watermanx
Indian jones - it's not good news for you but for anyone who has a disability, it's great news. so STFU.
mix's Avatar - Comment posted on 08/06/2010 12:33
mix
Back to my original post: How about someone make a youtube video with THIS:

Some guy comes into the room with HUGE muscley legs and his friend asks if he's been working out or something, he replies "nope" just been playing Call of Duty 4. The next scene shows him playing Kinect CoD and T-bagging for a whole min (squats) before going back to the game.

I would lol at something like that....lol
flea friend's Avatar - Comment posted on 08/06/2010 12:44
flea friend
The technology of a camera that can read lips and sign language? Cool.

A game system that can do that? Eh.
brainderailment's Avatar - Comment posted on 08/06/2010 12:46
brainderailment
How close to the camera do they have to be? Even the most high quality cameras with have trouble dealing with the blurry quickness of a signer. And lip reading is even faster and more precise.
KyleGamgee's Avatar - Comment posted on 08/06/2010 12:55
KyleGamgee
Looking forward to the website that posts transcripts of what Kinect thought people were saying.

It'll be like iPhone's autocorrect but way more hilarious.
Mr Andy Dixon's Avatar - Comment posted on 08/06/2010 13:05
Mr Andy Dixon
Shoot, Indiana Jones doesn't like it, so now I don't anymore. He always gets me!
Handy's Avatar - Comment posted on 08/06/2010 13:17
Handy
Too bad the only sign most people will use is pretending to wank.
Sir playedallot's Avatar - Comment posted on 08/06/2010 13:18
Sir playedallot
mrandydixon
Whats wrong with that sign? Its the internatinal sign for ''i got somthing on the left side of my sunglasses'' since 1923

about the news:
i dont want to say ''i told you so'' but *quick turn around pointing on everyone* ''HA I TOLD YOU SO''
By now its just a gimick but so was voicechat in the beginning.

play a game, frag someone, hold the shoulder button and make a sign, YESS. Also this could be used to make secret comands to sneak up to someone, point on somthing ingame, grab, coordinate quiet assaults. They could go this far and enable the voicechat for everyone. If you dont want the enemys to hear you if youre close to them...be quiet. The distance, if and when someone hears you talking, would become now really importend. Would add much more tactical depth/possibilities!!!

GRAW3 was told to use some of the features, wonder how the move will handle that, if at all. We will see SexualChoclate for sure isnt that far away..he will explain it to us (and why its still better then kinect)
Neroisonfire's Avatar - Comment posted on 08/06/2010 13:22
Neroisonfire
Great news for the hearing impaired. But for the rest of, I doubt it'll be as good as it says it is at recognizing input. This really screams of hype.
TriplZer0's Avatar - Comment posted on 08/06/2010 13:42
TriplZer0
I know how to say "Bacon, please" in sign language. That is all I need to know. And for that matter all Kinect needs to know.
Monodi's Avatar - Comment posted on 08/06/2010 13:45
Monodi
That means it can recognize fingers then? It would be interesting if it did.
Syncmaster's Avatar - Comment posted on 08/06/2010 14:59
Syncmaster
if this indeed really work, and work well, I can see it being used to much more than playing games
tehAnt1the1s1s's Avatar - Comment posted on 08/06/2010 15:25
tehAnt1the1s1s
To everyone who thinks that this means Kineckt can recognize fingers, I doubt that is what it is doing. I took four years of ASL and the signs are more about shape and motion categories than which fingers are being used. Obviously you have to use the correct fingers to get the correct shape but the software is probably not looking at the individual fingers but rather the shape of the entire hand.

(Sorry if I rambled there, I had surgery this week and am still pretty messed up on painkillers)
OWENR22's Avatar - Comment posted on 08/06/2010 15:40
OWENR22
Wow, that's actually pretty cool. I didn't expect to ever say that about Kinect.
The Nakedest's Avatar - Comment posted on 08/06/2010 15:49
The Nakedest
What I see happening is that it will help some mute gamers, but for the most part, it will be kids. The kids who got this for their birthday, or because they didn't make potty in their pants, will be using this. They don't know sign, but that won't stop them. Think about it, joining a game to hear some bastard 10 year old, flailing his fist about in front of the kineckt, producing a robotic voice spouting nonsense. Think about all the "FOOT HOUSE TALL AROUND HAPPY TALL FOOT BITE BEHIND FORK FORK FORK" and tell me you don't want to go set fire to a middle school.
tenz's Avatar - Comment posted on 08/06/2010 16:30
tenz
It would be cool If someone who doesn't walk can use the damn thing.....
Archwright's Avatar - Comment posted on 08/06/2010 16:51
Archwright
Finally, something worth a damn from Kinect.

I don't know how it will be utilized, but it may be cool to use as gesture macros.
Syn's Avatar - Comment posted on 08/06/2010 16:53
Syn
Well I hope it recognizes what I'm saying better than any phone I've used.
otogi_guy's Avatar - Comment posted on 08/06/2010 17:25
otogi_guy
heh, i have a xboxLive friend that is in a deaf gamer's group. They must all be pretty ecstatic over news like this.
Nathan MBC's Avatar - Comment posted on 08/06/2010 19:00
Nathan MBC
hmmmm......WEEEEEEEEEEEEEST SIIIIIIIIIIIIIIIIIIDE!!!!!!!!!!!!!!!!!!!
Amaru's Avatar - Comment posted on 08/06/2010 19:18
Amaru
Half-Life 2 Episode 3 exclusively for Kinect CONFIRMED
deityofanime's Avatar - Comment posted on 08/06/2010 19:28
deityofanime
I don't know the sex signs, but I still think I could get the sex messages across.
onomatapedalo's Avatar - Comment posted on 08/07/2010 06:10
onomatapedalo
That does actually sound pretty incredible.

A little bit worried about the whole 'the Xbox will be able to lip-read, so it knows whether you're bad-mouthing it behind it's back' thing, though.
laundromatty's Avatar - Comment posted on 08/07/2010 14:29
laundromatty
I'm having trouble believing Kinect will be quick enough to recognize the fast-paced signing of an experienced signer and all the intricacies that come with the language. If anything, it's more likely to be able to read slow fingerspelling and simple signs like the one used in the header for 'I love you'.

A more realistic equivalent of voicechat, I think, would be to integrate video phone functionality while playing online multiplayer, but I can't imagine how that would work without taking up too much of the screen.
lewness's Avatar - Comment posted on 08/07/2010 23:47
lewness
Cool stuff. I just hope it doesn't widen the already open floodgates of douchebaggery.
coiled string's Avatar - Comment posted on 08/08/2010 05:03
coiled string
On the home improvement scale system this is now "Mr expensive developer/builder this is what I want.. Swimming pool, jacuzzi, new doors."
Then comes the holy shit moment of "how much" I'll settle for some chrome taps please.

Back to kinetic I think most of this capacity was stripped to get it's price down. As for sign language in the UK we have a different language for sign as probably do the French, etc..

Will you need more language discs for European games to cover the languages. Will some parts of Canada allow American only sign games to be sold in it's territories? without French sign equivalents.
I know microsoft is US centric (I've never seen a Zune outside of the US borders) but they will need to be careful on this option with world publicity.

After though how do you sign while playing with a controller in your hand or even using hand gestures for controls won't the two conflict??
Killereffect's Avatar - Comment posted on 03/30/2012 12:18
Killereffect
Id just like to let u know how much I learnt from your blog Dugg you.Hope 2 be back fast for some more good stuff forfait b and you forfait mobile internet sms illimite forfait bloque forfait mobile blackberry
prev next

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!