HACKING OUR FUTURE

SUGGESTED LEAD IN:

Predicting future technologies is a risky business, at best.

But what we are about to show you is all but sure to be part of our lives very soon.

It’s known as gesture technology - using our body movements to control a computer - and it represents a major leap in how we will communicate with the digital world. No pad, no keyboard, and no mouse.  

As you’ll see, it starts off with an incredible game from Microsoft... but that is not the story. It’s actually about a group of hackers from around the world who have taken a gaming device and want to change the way we live.

It’s a future right out of the movies.

---------------

[TC: 01:00:00]
Less than 10 years ago controlling a computer with hand gestures was science fiction.

Well, it looks like the future is here.

OK, this version is a bit basic....

And you might not have this in your living room, yet... but it’s closer than you think.

If you’re one of the millions that got a Kinect in recent weeks, this technology is sitting next to your television... right now.

And for you slow adopters out there, this is the Kinect.

It’s a small black device that plugs in to your Microsoft Xbox gaming console and transports you, the player, into the game.

It recognizes the shape of the human body and responds to your gestures.... there’s no controller, no joystick, it just sees you.

Pretty cool stuff, and a major advance in gaming technology.

[TC: 01:00:57]
But what you don’t realize - even if you’re not into gaming - is that this technology could change the way you live.  

(UPSOUND: 3, 2, 1…..)

Since it’s launch in November the $150 Kinect has become the fastest selling consumer device in history, shifting 8 million units in just it’s first two months.

This lucky man didn’t have to wait in line for his Kinect.... as an editor of the technology blog, Engadget, Ross Miller gets to play games for a living... and he explains how the Kinect works.

Ross Miller, Editor, Engadget
SO, WHAT WE HAVE HERE, IS WE HAVE THREE SENSORS. THIS ONE IS YOUR STANDARD KIND OF WEBCAM. IT’S WHAT YOU SEE ON YOUR CAMERAS, IN FRONT OF YOUR PHONES NOW. AND THESE TWO ACTUALLY WORK TOGETHER TO GET A SENSE IN THREE DIMENSIONS WHAT IS IN FRONT OF YOU. IT USES INFRARED BEAMS TO KIND OF PROJECT LITTLE DOTS, AND THIS READS THE DOTS AND SAYS OK, THIS IS FORWARD AND THIS IS BACK. AGAIN, IT GIVES YOU A SENSE OF DEPTH OF THE ROOM.

[TC: 01:01:55]
So 3D technology is great news for gamers.

But it doesn’t end there, and this is where it gets interesting... because there’s another community who have harnessed the Kinect’s potential far beyond the gaming world.

The hackers!

Ross Miller
WHAT REALLY JUMP STARTED THE KINECT HACKING SCENE WAS ADAFRUIT INDUSTRIES, WHO SET OUT WHAT ULTIMATELY BECAME A $3000 BOUNTY FOR SOMEONE TO KIND OF FIGURE OUT HOW TO GET THE KINECT TO TALK TO THE COMPUTER.

And it was this engineer in New York who kicked off what has become a revolution in gesture technology. She set up a competition for the first person to hack the Kinect.

Limor Fried, Adafruit Industries
WE’RE TRYING TO ALLOW PEOPLE WHO BOUGHT THIS KINECT, THEY BOUGHT THE HARDWARE, TO USE IT FOR MORE THAN MICROSOFT MAYBE WOULD INITIALLY ALLOW THEM TO.

(UPSOUND HECTOR: Hi there….)

and within days a hacker in Spain posts on the web free software to do just that...

Limor Fried got what she was after - a way for Kinect’s 3D video to be used with a computer rather than an Xbox.

[TC: 01:03:00]
In other words, repurposing the Kinect for uses beyond gaming.

...what uses? Well, get online and check out Kinecthacks.net, where you’ll find plenty of examples. It can be anything from controlling a robot, to puppeteering, to actually getting a tune out of an air guitar, and yes, they’ve already come up with a sex application... anything that utilises your body’s movements.

This is the brand new world of gesture technology, and while it might be hard to see how something like this will have any effect on your life.... there’s no doubt that some application like it will soon be entering your home.

PTC: “SO, EVEN IF IT’S JUST TO ACCESS RECIPES WHILE YOUR HANDS ARE UNAVAILABLE.”  THERE ARE DEVELOPERS ALL AROUND THE WORLD FIGURING OUT WAYS TO BRING GESTURE TECHNOLOGY RIGHT INTO YOUR LIFE.

And in universities too... would you believe that within a couple of months of its launch there are already courses teaching students the science of Kinect hacking?

[TC: 01:04:00]
Limor Fried
THE KINECT IS LIKE THE HOLY GRAIL OF LOW COST 3D VIDEO. IT IS PERFECT FOR ARTISTS, ENGINEERS, ROBOTICISTS, MEDICAL USES, EVERYTHING, AND STUFF THAT WAS PREVIOUSLY IMPOSSIBLE, OR SO EXPENSIVE, IS NOW OFF THE SHELF FOR $150.

And its low price is why this technology is significant. 3D video has suddenly become available to everyone... and this could really change how we interact with the digital world.

But hold on, this piece of technology has been hacked... Isn’t that illegal?

Here’s an intellectual property lawyer who knows a lot about technology.

Mike Kraus
SO, IS HACKING ILLEGAL?

P. Anthony Sammi, Skadden, Arps, et al.
HACKING CAN BE ILLEGAL.... AN ARGUMENT CAN BE MADE THAT YOU ARE NOT HACKING THE KINECT, YOU’RE MERELY USING IT FOR A DIFFERENT PURPOSE. ALONG THE SAME VEIN AN ANALOGY WOULD BE IF I SELL YOU A CHAIR. YOU HAVE A RIGHT TO USE THE CHAIR. YOU PAID ME FOR THE CHAIR. BUT YOU DON’T USE IT AS A CHAIR, YOU  USE IT AS A LADDER. YOU’RE NOT TAKING APART THE CHAIR. YOU’RE NOT CHANGING THE CHAIR. YOU’RE JUST USING IT FOR A DIFFERENT PURPOSE. THAT MAY NOT BE PROTECTABLE OR ENFORCEABLE BY ME THE SELLER OF THE CHAIR.  

[TC: 01:05:14]
So, it sounds like there is a misconception around the term hacker.


Ross Miller
SO, HACKER AS IT’S BEING USED HERE IS KIND OF A MISNOMER. WHEN YOU HEAR HACKER YOU THINK THESE DEVIOUS PEOPLE WHO ARE STEALING YOUR CREDIT CARDS... WHAT HACKERS ARE REALLY DOING... IS JUST FINDING A NEW WAY TO REPURPOSE TECHNOLOGY. IT’S TAKING A PIECE, WELL, THIS IS A GAMING UNIT AND THEY ARE THINKING, WELL, WHAT ELSE CAN I DO WITH IT?

Garratt Gallagher, MIT Robotics Researcher
I’M A RESEARCHER AT MIT AND I’M A HACKER.

That’s right... a hacker at MIT... and Garratt has spent the last four months repurposing the Kinect.

IT'S NICE TO WAVE YOUR ARMS AROUND AND HAVE IT ACTUALLY DO REAL THINGS. IT'S ACTUALLY WHY I GOT INTO ROBOTICS IN THE FIRST PLACE.

[TC: 01:05:57]
Garratt Gallagher created the “Minority Report” interface.

He was one of the first hackers to explore the potential uses of the Kinect’s gesture technology... and has made prize-winning hacks in the process.  

But to make this happen he had to first see the world through the Kinect’s eyes.

Garratt Gallagher
AS YOU CAN SEE HERE I HAVE THE 3D POINT CLOUD... AND THIS IS NOT WHAT YOU’D NORMALLY BE SEEING WITH THE KINECT HOOKED UP TO YOUR XBOX. BUT THIS IS THE DATA THAT THE XBOX IS ACTUALLY GETTING.

And it’s up to Garratt’s imagination what to do with this data...

Like creating a synthesizer with just a pen and paper

(UPSOUND synthesiser noise)

By programming the Kinect to recognize different forms Garratt is able to assign specific commands to these shapes for the computer to follow - in this case to play notes.

(UPSOUND: synthesiser noise)

Garratt Gallagher
IT DETECTS WHEN SOMETHING IS OVER THAT BUTTON AND IF IT’S CLOSE ENOUGH IT MAKES A SOUND.

[TC: 01:06:57]
These are very early days in the world of gesture technology, but judging by the ideas that have already been inspired by the Kinect in the short time since its launch, it makes you wonder... what’s coming next?

I did get a robot to pick up my lunch box.

Mike Kraus
BUT HOW USEFUL IS THAT?

OK, not very useful... but it doesn’t take much imagination to come up with some valuable applications.

In Moscow they’ve already come up with what might be the first commercial use of Kinect’s gesture technology: an interactive shopwindow.

But looking more into the future....

This orthopaedic surgeon is interested in what Kinect’s technology can bring to his field.

He already uses the most cutting edge surgical techniques in his operating room... and can see a day where some of the medical Kinect hacks in development will become reality.

[TC: 01:07:50]
Andrew Feldman, MD, NYU Langone Medical Center
THIS GESTURE TECHNOLOGY IS INCREDIBLE. I AM JUST LOOKING INTO THE FUTURE AND I SEE THE POTENTIAL OF HAVING A CAT SCAN OR AN MRI LITERALLY RIGHT IN FRONT OF YOUR EYES, YOU’LL BE ABLE TO WHISK IT IN FRONT OF YOU AND USE IT IN REAL TIME IN SURGERY.... AND THE MOST SCIENCE FICTION TYPE THING, THAT I ALWAYS LOVE, IS POTENTIALLY NOT EVEN TOUCHING A PATIENT, FOR STERILITY REASONS, IT’S SAFER. WOULDN’T IT BE INTERESTING IF SOMEONE WAS IN RUSSIA AND I WAS OPERATING IN NEW YORK? THAT’S THE FUTURE.

...and that might be quite a long way off, but there are Kinect hacks whose practical applications are right around the corner.

For example.

A team at Georgia Tech are developing software that allows the Kinect to read sign language, which, after all, is just another form of hand gesture.

And what of the military....

Professor Austin Long, Military Expert, Columbia University  
I THINK THE MILITARY WOULD ABSOLUTELY BE INTERESTED IN SOMETHING LIKE KINECT. IT GIVES A CHEAP WAY TO CONTROL A SMALL HELICOPTER ROBOT AND THINGS LIKE THAT OR A ROBOT THAT COULD BE USED TO CLEAR ROUTES OR LOOK FOR IMPROVISED EXPLOSIVE DEVICES IN PLACES LIKE IRAQ AND AFGHANISTAN. /// THE MILITARY HAS STRONG LINKS TO MANY OF THE RESEARCH UNIVERSITIES, FUNDS RESEARCH IN THESE PLACES, AND REALLY KEEPS UP WITH A LOT OF WHAT GOES ON, INCLUDING THINGS THAT MIGHT SEEM AS TRIVIAL AS HACKS BY STUDENTS.
[TC: 01:09:07]
And Microsoft too are keeping an eye on the Kinect hacks... in a statement they said:

“The enthusiasm in the scientific community... around the potential applications of [the Kinect] is exciting to see..... we do note, however, that any of these uses of the Kinect... are not licensed or authorized by Microsoft.”
Alex Kipman, Microsoft, Kinect for Xbox 360

So what exactly is Microsoft after here?

P. Anthony Sammi, Intellectual Property Lawyer, Skadden, Arps, et al.
I THINK WE ARE SEEING A BIT OF A SHIFT LATELY IN THE WAY COMPANIES ARE APPROCHING HOW TO DEAL WITH THESE ISSUES. IN THE PAST IT’S BEEN VERY PROTECTIONIST. THIS IS MY PRODUCT, THIS IS MY OPERATING SYSTEM, DON’T TOUCH IT. // THIS IDEA OF REPURPOSING TECHNOLOGY IS BECOMING MORE AND MORE ACCEPTED BY COMPANIES. THEY DON’T NECESSARILY WANT YOU TO HACK THEIR MACHINES OR THEIR SOFTWARE. HOWEVER, IF THEY GIVE THE CONSUMER THE LATITUDE, THE ABILITY TO REPURPOSE SOME OF THEIR SOFTWARE AND MAKE IT THEIR OWN, THE COMPANIES CAN GAIN MARKET SHARE AND ALSO LEARN FROM WHAT THE CUSTOMERS ARE DOING, WHAT THE MARKET WANTS.

[TC: 01:10:03]

[Minority Report]

A future that looks like Minority Report might not be here quite yet.... but going by Microsoft’s sales figures for the Kinect, the market wants gesture technology.

and while it’s still in its early development... and no one knows which way the technology is going...

[shots of kitchen]

...it is fun to imagine how it will become part of our lives.

And Kinect hacks... are just the start of that future.

[TC: 01:10:30]

-------------------------------------END------------------------------
© 2024 Journeyman Pictures
Journeyman Pictures Ltd. 4-6 High Street, Thames Ditton, Surrey, KT7 0RY, United Kingdom
Email: info@journeyman.tv

This site uses cookies. By continuing to use this site you are agreeing to our use of cookies. For more info see our Cookies Policy