ArtsAutosBooksBusinessEducationEntertainmentFamilyFashionFoodGamesGenderHealthHolidaysHomeHubPagesPersonal FinancePetsPoliticsReligionSportsTechnologyTravel

What the Heck are Eigenvalues and Eigenvectors?

Updated on June 2, 2010
Google campus
Google campus

How to Quickly End a Dinner Conversation

There are certain words that will put a speedy end to any dinner conversation.  Eigenvalue, eigenvector, and eigenfunction are probably in the top 100 such words. They are used in linear algebra and unfortunately, when they are used, they are rarely explained.  If you do happen to find them, then most likely, you have opened a technical book by mistake.

Consider the following conversation as an example:

Guest:  Do you feel that Google will continue its dominance of search?

Mathematician:  I feel confident that Google's use of eigenvectors places it in a unique position of importance among...

Guest:  (yawn) 

Last year, a book was written which attempted to explain the mathematics behind Google's page rank algorithm.  One of the chapters of the book is called:  The $25 billion dollar Eigenvector.

My goal in this hub is to explain the intuitions behind these terms in an effort to explain what they are, how they are used, and some basic ideas about them.

Eigen this and Eigen that

The prefix "eigen" is itself a German word which means "proper" or "characteristic (see here). Unfortunately, this doesn't help us very much in understanding what they are other than to suggest that they were invented by a German mathematician. There is some truth to this since possibly the first person to give them their current name was the German mathematician David Hilbert (see, here). Although, it may have also been the German physicist Hermann Ludwig Ferdinand von Helmholtz who was first (see, here).

Initially, eigenvalues were called "Proper Values" in the United States but that term is no longer used. Today, they are universally called eigenvalues and eigenvectors (for a complete history of the term, see here).

Eigenvalues and Eigenvectors defined

An eigenvalue is a number that is derived from a square matrix.  A square matrix is itself just a collection of n rows of n numbers.  An eigenvalue is usually represented by the Greek letter lamdba (λ).

Let A be a square matrix (a collections of n rows of n numbers which means that there are n x n numbers in total).

Let x be a nonzero vector.  A vector is just a column of numbers.  A nonzero vector is any vector where not all the numbers are 0.   By convention, a vector that consists entirely of 0's is called the 0 vector.

We say that a number is the eigenvalue for this square matrix if and only if there exists a nonzero vector x such that Ax = λx where:

A is the square matrix

x is the nonzero vector

λ is a nonzero value.

In this circumstance, λ is the eigenvalue and x is the eigenvector.

So, who cares?

So far, we've shown that certain square matrices satisfy an equation such that:

Ax = x

So what?  Why should I care about matrices, nonzero vectors, eigenvalues, and eigenvectors?

The major reason for studying eigenvalues and eigenvectors is that they are used in many important mathematical results.  Perhaps, it makes sense to show one example of a real world application before answering the other questions.

The Tacoma Narrows Bridge today
The Tacoma Narrows Bridge today

Eigenvalues and the Collapse of the Tacoma Narrows Bridge

On July 1, 1940, the Tacoma Narrows Bridge opened in Washington state.  It connected the city of Tacoma with the Kitsap Penninsula and ran over the Tacoma Narrows which is a strait across the Puget Sound.  Four months after it was built, it collapsed.  This was captured in film and was later nicknamed "Gallopin' Gertie".  The full story can be found here.

Believe it or not but this collapse can be explained in engineering terms using the idea eigenvalues.

The Collapse of the Tacoma Narrows Bridge in 1940

The Bridge Collapse and Eigenvalues

Why did the bridge collapse?

One explanation centers around natural frequencies.  The natural frequency is "the frequency at which a system naturally vibrates once it has been set into motion" (from this article).  In other words, the natural frequency is the characteristic motion of structure.  It's the motion that a structure takes on in response to wind or being walked on.  It is especially important in the design of musical instruments and in the tuning of radios.

Mathematically, the natural frequency can be characterized by the eigenvalue of the smallest magnitude.

The model suggests that the "oscillations of the bridge were caused by the frequency of the wind being too close to the natural frequency of the bridge." (from this article)  When frequencies match, they compound which proved too strong a force for the bridge.

The same type of collapse can happen with soldiers marching.  If soldiers march in lock step too close to the natural frequency of a bridge, then it is possible, under some circumstances, for the bridge to collapse.

Comments

    0 of 8192 characters used
    Post Comment

    • profile image

      olivier 

      3 years ago

      Please go ahead with explainations..You did not finish ? Where are paragraphs that follow '... for the bridge to collapse' ?

    • profile image

      einstein baby 

      5 years ago

      Actually the correct explanation is that the bridge fell due to implosion of the particles caused by excessively released dark enery as a result of wind energy bending the space-time of the vibration of the bridge. This explanation is not found in any of the text books of the universe.

    • profile image

      Erwin 

      5 years ago

      This article says nothing about practical usage of Eigen values and Eigen vectors. Just a waste of time.

    • profile image

      om 

      5 years ago

      stop fighting to each others , this is not a betel field

    • profile image

      Erik 

      5 years ago

      Sorry, but the collapse of the Tacoma Narrows Bridge's is a really bad example for a resonance catastrophe, as suggested here, because it really isn't -- therefore it is also not analogous to marching soldiers, whose unison gait excite the characteristic frequency of the bridge.

      The collapse of the T N bridge is a nonlinear phenomenon, and probably was caused by aerodynamic flutter (see for instance here, http://en.wikipedia.org/wiki/Tacoma_Narrows_Bridge...

      Also, the explanation that the 'wind has the same frequency as the bridge' makes absolutely no sense, considering that the wind as such most likely did not have any oscillatory motion by itself.

      I think it's great to popularize such topics, but it'd be good to do a little research before bringing about such explanations. Alas, perhaps I can't blame the writer for this mistake, as the false explanation for the collapse of the TN bridge is extremely widely spread, even in text books.

    • Manna in the wild profile image

      Manna in the wild 

      5 years ago from Australia

      The fundamental frequency is the lowest component in a non sinusoidal waveform.

    • profile image

      manna in the wild 

      5 years ago

      Why smallest?

      Mathematically, the. "natural frequency can be characterized by the eigenvalue of the. smallest magnitude.

    • profile image

      eigenCheers 

      5 years ago

      This following link is much better than this article where you can find meat in just firt 2-3 slides :)

      http://www.scribd.com/doc/23290356/Eigenvalues-and...

    • profile image

      Tliimfee 

      5 years ago

      So way can eigenvectors and eigenvalues recreate data? What is the intuition behind that? What does it mean to be the principal eigenvalue, how does that capture most of the data?

    • profile image

      sham 

      6 years ago

      where is the meat?????

    • profile image

      Joshi 

      6 years ago

      @ anothermathgeek, You are a rare breed my friend- You can bring the beauty of math to the masses. Keep up the good work. I'll be following your posts from now.

    • mathsciguy profile image

      mathsciguy 

      7 years ago from Here, there, and everywhere

      I remember a funny story about eigenvalues that your intro reminded me of. So, our department head was talking about Markov Chains and brought up the theorem about any Markov chain having 1 as an eigenvalue. He showed us a proof of it and then said, "Now, if you are ever driving in your car and someone stops you and shows a Markov chain matrix and asks you for an eigenvalue of it, you will be able to know at least one." Loved that guy.

    • anothermathgeek profile imageAUTHOR

      anothermathgeek 

      7 years ago from East Bay, California

      Hi Aaron,

      This is meant as a high level overview. Based on the feedback I've received, I'll write another hub that goes a bit deeper into the notation and the mathematics.

    • profile image

      Aaron 

      7 years ago

      That's it??? Seems like a nice introduction, but where is the substance?

    • profile image

      ssss 

      7 years ago

      can you tell what is the eigen value response between the two square matrix

    • profile image

      l2oss 

      7 years ago

      pretty sweet dude. One thing about the article isn't totally accurate though, as eigenvalues CAN be zero. I like the way you explain things it is very clear and concise.

    • profile image

      Pramod Rawat 

      8 years ago

      Like the hub.

      Thanks to write this please write more.

    • ss sneh profile image

      ss sneh 

      8 years ago from the Incredible India!

      Hi! All particles in the universe have tendency to vibrate.

      It's the same with a bridge...the particles that constitute that bridge also vibrate with different frequencies- called natural frequencies.

      When wind blows on a bridge it is possible that the wind can make some of these particles to vibrate with the same frequencies. When vibrations of two particles fall constructively then the amplitude of the combined vibrations of those particles become maximum.

      If you give continuous external excitation with a certain frequency... like continuous blowing of wind with a particular rhythm- then that can cause all particles to vibrate with a combined frequency with the maximum amplitude - called resonance.

      This concentration of energy which can cause maximum amplitude - maximum displacement from the horizontal position of that bridge - can damage it if the resonance effect is ignored while designing.

      I wonder what the phenomenon of resonance has got with Google ranking?-- Thanks

    • anothermathgeek profile imageAUTHOR

      anothermathgeek 

      8 years ago from East Bay, California

      Thanks, Larry. I'm planning to write more as I have time.

    • Ben Evans profile image

      Ben Evans 

      8 years ago

      Good explanation of eigenvalues. It is a very interesting seeing that it is part of Google's algorithm.

      Cheers,

      Bem

    • nicomp profile image

      nicomp really 

      8 years ago from Ohio, USA

      Wonderful. You are a rare bird; a geek who can explain stuff. Thank you!

    • profile image

      Dan 

      8 years ago

      Thanks - this article is the best I've found on the _whole_ internet to discuss/explain what eigenvalues/functions really are. Please continue the article !

    • profile image

      botsbry 

      8 years ago

      Does this finish with the paragraph about soldiers or is there more?

    • anothermathgeek profile imageAUTHOR

      anothermathgeek 

      8 years ago from East Bay, California

      Hi Subha,

      Click on the link above to read how the eigenvalue method is used by Google.

      -Larry

    • profile image

      subha 

      8 years ago

      how the eigenvalue method used in search engine?

    working

    This website uses cookies

    As a user in the EEA, your approval is needed on a few things. To provide a better website experience, hubpages.com uses cookies (and other similar technologies) and may collect, process, and share personal data. Please choose which areas of our service you consent to our doing so.

    For more information on managing or withdrawing consents and how we handle data, visit our Privacy Policy at: https://hubpages.com/privacy-policy#gdpr

    Show Details
    Necessary
    HubPages Device IDThis is used to identify particular browsers or devices when the access the service, and is used for security reasons.
    LoginThis is necessary to sign in to the HubPages Service.
    Google RecaptchaThis is used to prevent bots and spam. (Privacy Policy)
    AkismetThis is used to detect comment spam. (Privacy Policy)
    HubPages Google AnalyticsThis is used to provide data on traffic to our website, all personally identifyable data is anonymized. (Privacy Policy)
    HubPages Traffic PixelThis is used to collect data on traffic to articles and other pages on our site. Unless you are signed in to a HubPages account, all personally identifiable information is anonymized.
    Amazon Web ServicesThis is a cloud services platform that we used to host our service. (Privacy Policy)
    CloudflareThis is a cloud CDN service that we use to efficiently deliver files required for our service to operate such as javascript, cascading style sheets, images, and videos. (Privacy Policy)
    Google Hosted LibrariesJavascript software libraries such as jQuery are loaded at endpoints on the googleapis.com or gstatic.com domains, for performance and efficiency reasons. (Privacy Policy)
    Features
    Google Custom SearchThis is feature allows you to search the site. (Privacy Policy)
    Google MapsSome articles have Google Maps embedded in them. (Privacy Policy)
    Google ChartsThis is used to display charts and graphs on articles and the author center. (Privacy Policy)
    Google AdSense Host APIThis service allows you to sign up for or associate a Google AdSense account with HubPages, so that you can earn money from ads on your articles. No data is shared unless you engage with this feature. (Privacy Policy)
    Google YouTubeSome articles have YouTube videos embedded in them. (Privacy Policy)
    VimeoSome articles have Vimeo videos embedded in them. (Privacy Policy)
    PaypalThis is used for a registered author who enrolls in the HubPages Earnings program and requests to be paid via PayPal. No data is shared with Paypal unless you engage with this feature. (Privacy Policy)
    Facebook LoginYou can use this to streamline signing up for, or signing in to your Hubpages account. No data is shared with Facebook unless you engage with this feature. (Privacy Policy)
    MavenThis supports the Maven widget and search functionality. (Privacy Policy)
    Marketing
    Google AdSenseThis is an ad network. (Privacy Policy)
    Google DoubleClickGoogle provides ad serving technology and runs an ad network. (Privacy Policy)
    Index ExchangeThis is an ad network. (Privacy Policy)
    SovrnThis is an ad network. (Privacy Policy)
    Facebook AdsThis is an ad network. (Privacy Policy)
    Amazon Unified Ad MarketplaceThis is an ad network. (Privacy Policy)
    AppNexusThis is an ad network. (Privacy Policy)
    OpenxThis is an ad network. (Privacy Policy)
    Rubicon ProjectThis is an ad network. (Privacy Policy)
    TripleLiftThis is an ad network. (Privacy Policy)
    Say MediaWe partner with Say Media to deliver ad campaigns on our sites. (Privacy Policy)
    Remarketing PixelsWe may use remarketing pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to advertise the HubPages Service to people that have visited our sites.
    Conversion Tracking PixelsWe may use conversion tracking pixels from advertising networks such as Google AdWords, Bing Ads, and Facebook in order to identify when an advertisement has successfully resulted in the desired action, such as signing up for the HubPages Service or publishing an article on the HubPages Service.
    Statistics
    Author Google AnalyticsThis is used to provide traffic data and reports to the authors of articles on the HubPages Service. (Privacy Policy)
    ComscoreComScore is a media measurement and analytics company providing marketing data and analytics to enterprises, media and advertising agencies, and publishers. Non-consent will result in ComScore only processing obfuscated personal data. (Privacy Policy)
    Amazon Tracking PixelSome articles display amazon products as part of the Amazon Affiliate program, this pixel provides traffic statistics for those products (Privacy Policy)