ArtsAutosBooksBusinessEducationEntertainmentFamilyFashionFoodGamesGenderHealthHolidaysHomeHubPagesPersonal FinancePetsPoliticsReligionSportsTechnologyTravel

Controlling Computers With Hand Gestures

Updated on April 19, 2013

Gesture Computer Control - Motion Control Technology

For awhile now gesture control systems have been used to control game consoles and TVs by gesturing has been available, and while there have been some great gadgets like the Natural Point TrackIR that enable head movements to control games, it's only recently that motion control devices have begun to make their way into desktop and laptop computer systems that allow you to control your computer with your hands by making gestures and without using a mouse or keyboard.

The 2002 Movie - Minority Report has a now famous scene showing Tom Cruise showing off a gesture controlled computer, shifting through images and data just using his hands, virtual reality fans have dreamt about different ways of controlling computers, very very soon there will be a wide range to choose from and the ability to control computer with gestures will be ubiquitous.

Initially these devices were invented to help people with spinal injuries or suffers of motor neurons disease that left them without the ability to use their hands, however the benefits that these devices can bring to everyone are quite astonishing, they are set to completely revolutionize how we interact with computers.

Now companies such as AMD are building the technology to allow facial and hand recognition into their chipsets, and Microsoft want to miniaturize and embed its Kinect technology into everything from your kitchen worktop and surface tablet, which means that 2013 will see and explosion of gesture control computer applications.

Just recently Samsung announced it was building "Samsung Eye Scroll" into its next generation of Smartphones, already the Galaxy S3 can tell if a user is looking at the screen and keep it illuminating if it is, however in the future users will be able to scroll through the screen just by looking at it!

Leap Motion Controller image Courtesy of Amazon.co.uk

Gesture Control Approaches

There are a growing number of players in a market that is rapidly hotting up, at present there are three approaches being taken by the main developers that provide motion control for computer applications.

  1. Software Only - products such as those from Point Grab rely on the 2D camera built into many laptops, smartphones, or an add on web camera, to provide computer hand control.
  2. Wearable Sensors - there have been gloves and there are headsets such as the Oculus Rift that can sense movement and translate that into computer control, the latest is the MYO from Thalmic Labs. While the MYO is able to sense movement, it also can measure the electrical activity in your muscles, allowing for very complex hand gesture computer control.
  3. 3D spatial cameras - The Kinect, Leap Motion and the Camboard Pico all work by using a camera or cameras to sense the surroundings, detect and recognise movement.
  4. A hybrid is the Natural Point SmartNav and TrackIR, these rely on the user wearing a small reflective dot or a transmitter attached to a hat, heatset or other device to communicate with a receiver connected to your PC.

Leap Motion

The Leap Motion Natural User Interface (NUI) or Gesture Recognition technology was announced in May 2012 and is expected to ship May 13 2013 and gives both Mac and Windows Gesture Control.

Pre-orders are being taken now, go to the Leap Motion Website for more.

If you are in the UK you can also pre-order from Amazon.co.uk

Leap Motion Controller

Leap gesture control is provided by a small, silver box that is connected to, and powered via a standard USB connection, although plans are in the pipeline for a wireless version. It is able to sense individual fingers in both hands from about 1 metre away. Leap claim that the Motion has an accuracy or precision down to 0.01mm, making it easily able to detect the tip of a pen or stylus.

What gives the Leap Gesture Controller a significant advantage is the relatively low price for such a cutting-edge gadget and the >$12m investment it has received that has allowed it to distribute "thousands" to developers to ensure that as much software as possible is available on the consumer launch.

Also launching in May is the Leap Motion App Store - Airspace, which will allow you to quickly find applications that make use of this incredible technology.

Leap Motion Controller

Thalmic Labs MYO Gesture Control
Thalmic Labs MYO Gesture Control

Thalmic Labs - MYO

"Unleash your inner Jedi" - Thalmic Labs

At first the idea of wearing an armband to control your computer seems a bit clunky, however, because the device picks up minute electrical signals in your muscles, down to the movement of an individual finger, and because the electrical impulses begin even before your arm moves, the response time promises to be pretty quick. Also there is no need to map and analyze a visual image like some other devices, which again could give the MYO a distinct advantage over the competition.

The MYO communicates with devices using Bluetooth 4.0 Low Energy, power comes from rechargeable Lithium Ion batteries and computing power is provided by an ARM processor. Thalmic have developed their own muscle electrical activity sensing hardware which is partnered with 6-axis motion measurement.

Pre-orders are now being taken on the Thalmic Labs web-site.

Thalmic Labs MYO

Camboard Pico

The Camboard Pico is even more accurate than the Leap Motion, at least that is the claims. German company PMD Technologies has been making reference designs for some time now, and provides them to other manufacturers to integrate into their products.

You would expect something that has been in development for nearly 10 years to be pretty special. It follows on from their Camboard Nano, which was made available at a price of $690, although it is fair to say this was created as a pilot development rig and was never really intended to be in the hands of consumers, gamers and designers.

It remains to be seen if the Pico will ever be sold as a consumer item, but it's clear the technology will be influential and is very likely to appear in laptops and tablets soon.

PointGrab

The PointGrab solution is one of the few to rely solely on existing hardware, that is the 2D camera built into you laptop (it also works with standalone webcams). It also claims to work on tablets and smartphones that have a camera built in. However, as yet there is not date for it's release or price.

Kinect for Windows is here and available right now! - but you will need to be able to program it....

Ok so this, the original PC motion controller, isn't yet for you if you don't want to get your hands dirty coding and developing, however, it is the first commercially available gesture recognition device and there are plenty of great examples out on Youtube and the web to give you a good idea as to what is possible with this device.

Microsoft have, as of March 2013, released 22 examples of the underlying code as open source, presumably in an effort to increase usage of this device now that competitors such as the MYO and Leap Motion are getting closer to being released.

Kinect for Windows
Kinect for Windows

Utilize Kinect's sophisticated sensor technologies to create a natural user interface for your Window 7 or 8 PC.

 

The perfect partner for your Kinect for PC - Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot

Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot (Make: Books)
Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot (Make: Books)

This great book will ease you into developing for the Kinect even if you have limited programming experience.

 

Want to develop for Gesture Recognition Devices? - Try these books

Books on developing natural user interfaces for gesture recognition projects.

AMD Face Login, Gesture Control

AMD Face Login will allow you to use your face as a password, but the Chipset also has the capability to handle gesture control as well, with Microsoft also planning on making the Kinect hardware smaller and more easily incorporated into devices there seems little doubt that the technology will be embedded in everything from smartphones to car dashboards and performance art.

TrackIr 5 Premium Head Tracking for Gaming
TrackIr 5 Premium Head Tracking for Gaming

Primarily aimed at gaming, the TrackIR adds an incredible extra dimension to simulations and first person shooters, making the whole experience much more realistic. If you want to move your viewing angle in the game, just move your head.

 

The MYO from Thalmic Labs - Jedi like control of your devices
The MYO has been designed to work with you Mac and PC. Anything you can control with a mouse you can control with the MYO, be that games, web browsing, music...

Virtual Reality Gaming Headsets
Ever since I made a special trip to London to play on the Virtuality Video Game in Covent Garden I've been fascinated by Virtual Reality, this was compounded...

Controlling Computers With Hand Gestures
For awhile now gesture control systems have been used to control game consoles and TVs by gesturing has been available, and while there have been some great ...

Use this handy Amazon Search for other Computer Input and Gesture Recognition Devices

How will you use Gesture Recognition?

    0 of 8192 characters used
    Post Comment

    • cire81 lm profile image

      cire81 lm 

      5 years ago

      Motion sensing is a good technology but from a layman point of view, don't it look weird to be gesturing to yourself? Haha.. Just my comment

    • Babbages profile imageAUTHOR

      Babbages 

      5 years ago

      @RainDefence LM: That's a really good point, maybe the MYO will be easier in that respect as presumably you can program it to respond to pretty small movements and gestures, just clenching your fist or moving one finger (apparently), I guess we'll have to see when they finally ship!

    • RainDefence LM profile image

      RainDefence LM 

      5 years ago

      The problem I have with any motion sensing device is that they tend to need a lot of movement which is tiring. I have my mouse set to max sensitivity and play games with controller set the same way, I can move around with very little effort. All of the motion detecting games and inputs I have seen are just too tiring to use. That is me being lazy maybe, but when I'm settling in to game for hours, I don't want to be tired out from flailing around after a few minutes. That isn't relaxing.

    • flinnie lm profile image

      Gloria Freeman 

      5 years ago from Alabama USA

      Hi I like learning about new things. Thanks for sharing.

    • profile image

      anonymous 

      5 years ago

      I am not sure yet - still researching this technology

    • EzLoanLookUp LM profile image

      EzLoanLookUp LM 

      5 years ago

      it will be good to see pictures!

    • AllenJames LM profile image

      AllenJames LM 

      5 years ago

      I think sound recognition is enough, gesture can be kind of too tired...haha

    • GrimRascal profile image

      GrimRascal 

      5 years ago from Overlord's Castle

      I think so...

    • earaja profile image

      earaja 

      5 years ago

      they also developed a way to control your computer with your eyes

    • zulb88 profile image

      zulb88 

      5 years ago

      nice article bro :D

    • Babbages profile imageAUTHOR

      Babbages 

      5 years ago

      @anonymous: Haha I hadn't thought of that, yes you could be right!

    • profile image

      anonymous 

      5 years ago

      When the computer responds very slowly it might get a special salute lol

    working

    This website uses cookies

    As a user in the EEA, your approval is needed on a few things. To provide a better website experience, hubpages.com uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

    For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at: https://hubpages.com/privacy-policy#gdpr

    Show Details
    Necessary
    HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
    LoginThis is necessary to sign in to the HubPages Service.
    Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
    AkismetThis is used to detect comment spam. (Privacy Policy)
    HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
    HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
    Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
    CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
    Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the googleapis.com or gstatic.com domains, for performance and efficiency reasons. (Privacy Policy)
    Features
    Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
    Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
    Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
    Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
    Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
    VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
    PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
    Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
    MavenThis supports the Maven widget and search functionality. (Privacy Policy)
    Marketing
    Google AdSenseThis is an ad network. (Privacy Policy)
    Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
    Index ExchangeThis is an ad network. (Privacy Policy)
    SovrnThis is an ad network. (Privacy Policy)
    Facebook AdsThis is an ad network. (Privacy Policy)
    Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
    AppNexusThis is an ad network. (Privacy Policy)
    OpenxThis is an ad network. (Privacy Policy)
    Rubicon ProjectThis is an ad network. (Privacy Policy)
    TripleLiftThis is an ad network. (Privacy Policy)
    Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
    Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
    Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
    Statistics
    Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
    ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
    Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)