ArtsAutosBooksBusinessEducationEntertainmentFamilyFashionFoodGamesGenderHealthHolidaysHomeHubPagesPersonal FinancePetsPoliticsReligionSportsTechnologyTravel

Controlling Computers With Hand Gestures

Updated on April 19, 2013

Gesture Computer Control - Motion Control Technology

For awhile now gesture control systems have been used to control game consoles and TVs by gesturing has been available, and while there have been some great gadgets like the Natural Point TrackIR that enable head movements to control games, it's only recently that motion control devices have begun to make their way into desktop and laptop computer systems that allow you to control your computer with your hands by making gestures and without using a mouse or keyboard.

The 2002 Movie - Minority Report has a now famous scene showing Tom Cruise showing off a gesture controlled computer, shifting through images and data just using his hands, virtual reality fans have dreamt about different ways of controlling computers, very very soon there will be a wide range to choose from and the ability to control computer with gestures will be ubiquitous.

Initially these devices were invented to help people with spinal injuries or suffers of motor neurons disease that left them without the ability to use their hands, however the benefits that these devices can bring to everyone are quite astonishing, they are set to completely revolutionize how we interact with computers.

Now companies such as AMD are building the technology to allow facial and hand recognition into their chipsets, and Microsoft want to miniaturize and embed its Kinect technology into everything from your kitchen worktop and surface tablet, which means that 2013 will see and explosion of gesture control computer applications.

Just recently Samsung announced it was building "Samsung Eye Scroll" into its next generation of Smartphones, already the Galaxy S3 can tell if a user is looking at the screen and keep it illuminating if it is, however in the future users will be able to scroll through the screen just by looking at it!

Leap Motion Controller image Courtesy of Amazon.co.uk

Gesture Control Approaches

There are a growing number of players in a market that is rapidly hotting up, at present there are three approaches being taken by the main developers that provide motion control for computer applications.

  1. Software Only - products such as those from Point Grab rely on the 2D camera built into many laptops, smartphones, or an add on web camera, to provide computer hand control.
  2. Wearable Sensors - there have been gloves and there are headsets such as the Oculus Rift that can sense movement and translate that into computer control, the latest is the MYO from Thalmic Labs. While the MYO is able to sense movement, it also can measure the electrical activity in your muscles, allowing for very complex hand gesture computer control.
  3. 3D spatial cameras - The Kinect, Leap Motion and the Camboard Pico all work by using a camera or cameras to sense the surroundings, detect and recognise movement.
  4. A hybrid is the Natural Point SmartNav and TrackIR, these rely on the user wearing a small reflective dot or a transmitter attached to a hat, heatset or other device to communicate with a receiver connected to your PC.

Leap Motion

The Leap Motion Natural User Interface (NUI) or Gesture Recognition technology was announced in May 2012 and is expected to ship May 13 2013 and gives both Mac and Windows Gesture Control.

Pre-orders are being taken now, go to the Leap Motion Website for more.

If you are in the UK you can also pre-order from Amazon.co.uk

Leap Motion Controller

Leap gesture control is provided by a small, silver box that is connected to, and powered via a standard USB connection, although plans are in the pipeline for a wireless version. It is able to sense individual fingers in both hands from about 1 metre away. Leap claim that the Motion has an accuracy or precision down to 0.01mm, making it easily able to detect the tip of a pen or stylus.

What gives the Leap Gesture Controller a significant advantage is the relatively low price for such a cutting-edge gadget and the >$12m investment it has received that has allowed it to distribute "thousands" to developers to ensure that as much software as possible is available on the consumer launch.

Also launching in May is the Leap Motion App Store - Airspace, which will allow you to quickly find applications that make use of this incredible technology.

Leap Motion Controller

Thalmic Labs MYO Gesture Control
Thalmic Labs MYO Gesture Control

Thalmic Labs - MYO

"Unleash your inner Jedi" - Thalmic Labs

At first the idea of wearing an armband to control your computer seems a bit clunky, however, because the device picks up minute electrical signals in your muscles, down to the movement of an individual finger, and because the electrical impulses begin even before your arm moves, the response time promises to be pretty quick. Also there is no need to map and analyze a visual image like some other devices, which again could give the MYO a distinct advantage over the competition.

The MYO communicates with devices using Bluetooth 4.0 Low Energy, power comes from rechargeable Lithium Ion batteries and computing power is provided by an ARM processor. Thalmic have developed their own muscle electrical activity sensing hardware which is partnered with 6-axis motion measurement.

Pre-orders are now being taken on the Thalmic Labs web-site.

Thalmic Labs MYO

Camboard Pico

The Camboard Pico is even more accurate than the Leap Motion, at least that is the claims. German company PMD Technologies has been making reference designs for some time now, and provides them to other manufacturers to integrate into their products.

You would expect something that has been in development for nearly 10 years to be pretty special. It follows on from their Camboard Nano, which was made available at a price of $690, although it is fair to say this was created as a pilot development rig and was never really intended to be in the hands of consumers, gamers and designers.

It remains to be seen if the Pico will ever be sold as a consumer item, but it's clear the technology will be influential and is very likely to appear in laptops and tablets soon.

PointGrab

The PointGrab solution is one of the few to rely solely on existing hardware, that is the 2D camera built into you laptop (it also works with standalone webcams). It also claims to work on tablets and smartphones that have a camera built in. However, as yet there is not date for it's release or price.

Kinect for Windows is here and available right now! - but you will need to be able to program it....

Ok so this, the original PC motion controller, isn't yet for you if you don't want to get your hands dirty coding and developing, however, it is the first commercially available gesture recognition device and there are plenty of great examples out on Youtube and the web to give you a good idea as to what is possible with this device.

Microsoft have, as of March 2013, released 22 examples of the underlying code as open source, presumably in an effort to increase usage of this device now that competitors such as the MYO and Leap Motion are getting closer to being released.

Kinect for Windows
Kinect for Windows

Utilize Kinect's sophisticated sensor technologies to create a natural user interface for your Window 7 or 8 PC.

 

The perfect partner for your Kinect for PC - Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot

Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot (Make: Books)
Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot (Make: Books)

This great book will ease you into developing for the Kinect even if you have limited programming experience.

 

Want to develop for Gesture Recognition Devices? - Try these books

Books on developing natural user interfaces for gesture recognition projects.

AMD Face Login, Gesture Control

AMD Face Login will allow you to use your face as a password, but the Chipset also has the capability to handle gesture control as well, with Microsoft also planning on making the Kinect hardware smaller and more easily incorporated into devices there seems little doubt that the technology will be embedded in everything from smartphones to car dashboards and performance art.

TrackIr 5 Premium Head Tracking for Gaming
TrackIr 5 Premium Head Tracking for Gaming

Primarily aimed at gaming, the TrackIR adds an incredible extra dimension to simulations and first person shooters, making the whole experience much more realistic. If you want to move your viewing angle in the game, just move your head.

 

The MYO from Thalmic Labs - Jedi like control of your devices
The MYO has been designed to work with you Mac and PC. Anything you can control with a mouse you can control with the MYO, be that games, web browsing, music...

Virtual Reality Gaming Headsets
Ever since I made a special trip to London to play on the Virtuality Video Game in Covent Garden I've been fascinated by Virtual Reality, this was compounded...

Controlling Computers With Hand Gestures
For awhile now gesture control systems have been used to control game consoles and TVs by gesturing has been available, and while there have been some great ...

Use this handy Amazon Search for other Computer Input and Gesture Recognition Devices

How will you use Gesture Recognition?

    0 of 8192 characters used
    Post Comment

    • cire81 lm profile image

      cire81 lm 4 years ago

      Motion sensing is a good technology but from a layman point of view, don't it look weird to be gesturing to yourself? Haha.. Just my comment

    • Babbages profile image
      Author

      Babbages 4 years ago

      @RainDefence LM: That's a really good point, maybe the MYO will be easier in that respect as presumably you can program it to respond to pretty small movements and gestures, just clenching your fist or moving one finger (apparently), I guess we'll have to see when they finally ship!

    • RainDefence LM profile image

      RainDefence LM 4 years ago

      The problem I have with any motion sensing device is that they tend to need a lot of movement which is tiring. I have my mouse set to max sensitivity and play games with controller set the same way, I can move around with very little effort. All of the motion detecting games and inputs I have seen are just too tiring to use. That is me being lazy maybe, but when I'm settling in to game for hours, I don't want to be tired out from flailing around after a few minutes. That isn't relaxing.

    • flinnie lm profile image

      Gloria Freeman 4 years ago from Alabama USA

      Hi I like learning about new things. Thanks for sharing.

    • profile image

      anonymous 4 years ago

      I am not sure yet - still researching this technology

    • EzLoanLookUp LM profile image

      EzLoanLookUp LM 4 years ago

      it will be good to see pictures!

    • AllenJames LM profile image

      AllenJames LM 4 years ago

      I think sound recognition is enough, gesture can be kind of too tired...haha

    • GrimRascal profile image

      GrimRascal 4 years ago from Overlord's Castle

      I think so...

    • earaja profile image

      earaja 4 years ago

      they also developed a way to control your computer with your eyes

    • zulb88 profile image

      zulb88 4 years ago

      nice article bro :D

    • Babbages profile image
      Author

      Babbages 4 years ago

      @anonymous: Haha I hadn't thought of that, yes you could be right!

    • profile image

      anonymous 4 years ago

      When the computer responds very slowly it might get a special salute lol