How Search Engine Optimization Works – Know Such Engine Basic

SEO Basic

Search Engines start with crawling your pages, followed by indexing and your website URL being stored into the crawling software for future reference

Search Engine Crawling

Search engine “spider” – which is also known as crawler or robot. The robot is software that Search Engine uses to find out what’s new on the internet. The spider crawl the websites and loads the pages after which it follows the hyperlinks available on each page of the website. There are so many spider of Search Engine doing the work across multiple websites and scrolling for new pages

Crawling of pages by Search Engines is done with a purpose to load new pages to its database where the pages get indexed. Once your page has been indexed and your URL retrieved back, the spider will come crawling again to verify the pages some other times and if the URL is unavailable you will be deleted from the Search Engine Index

When these spider came knocking to your websites, they will look for robot.txt files. The robot.txt directs the spider on which part of the page should index and which one to ignore

Search Engines will find your websites either through direct URL submission or through hyperlink from other websites. You can also use paid or free services to submit your website or blog to Search Engine

Search Engine Indexing

After Search Engine have crawled your pages it is now time to get the pages index, and this is how indexing works, after the visit Search Engine will store information about the text of your page but not the entire pages, your Images, scripts, rich media and information about hyperlinks also get indexed

The hyperlinked text enables the Search Engines to determine the link popularity of the page, the page subject. Indexing of pages may take some few weeks if not months because it takes some time to get new sites and pages, the more you back link the higher chances of you being found and index faster

How Search Engine Does Page Ranking

Now your page has been index and probably not ranked, it is time to do the ranking by SE, there are factors that will determined how well your page rank on a particular Search Engine, and ranking is normally based from 0-10, the higher you rank the better. The two most factors that affect your ranking are

  • On Page Contents
  • Off Page Contents

On Page Contents

These are ingredients found on your page that will increase your ranking; they including keyword utilization and placement, to effectively use your keyword for better ranking consider using the keywords on your URL, title, first paragraph and on images. The other on page factor is good quality and original content, the more contents you upload the better

Off Page Contents

These are ingredients that enable your page ranking increase and are done outside your blog or website, techniques found here are back links – this are related or non related pages linking to your sites. The more related back link you have the better. The most important back link is one way linking. Here they point back to your site without you having to link back to them, the link popularity is determined by the anchor text, the link relevance and also known as link reputation. To aim for good page rank with off page content techniques one has to avoid the outgoing links, the more outgoing links you have the less you rank

To rank high you need as many one way back link as you can, the more quality and relevant back link the better. If this hub(article) get some incoming links the higher it will rank, but if it has as many outgoing links the lower it will rank


More by this Author


Comments 7 comments

Philipo profile image

Philipo 7 years ago from Nigeria

Thanks for sharing.


sarovai profile image

sarovai 7 years ago

Thank u oderog for the search engine's basic information like how is crawling and indexing.


suziecat7 profile image

suziecat7 7 years ago from Asheville, NC

Godd and informative Hub - thanks.


creativeone59 profile image

creativeone59 7 years ago from Gold Canyon, Arizona

Thank you for such an informative hub. creativeone59


fastfreta profile image

fastfreta 7 years ago from Southern California

I'm trying to learn what back links are, so I'm going to bookmark this hub, so when I learn I can use this one. This is a well written hub, however I feel as if I just read a Greek novel, (I don't read Greek), LOL! I know one day I'll be able to refer to this article and it will make sense to me. Great hub. Keep 'em coming.


oderog profile image

oderog 7 years ago from Nairobi Author

@Philipo - Thanks if you got information about search engine optimization useful.

@sarovai - Thanks fro stopping by and understanding about how search engines crawl and index your web pages

@suziecat7 - Thanks, hope you got something out of this hub and especially how back links are important when comes to search engine ranking of pages

@creativeone59 - Hi and thanks for your compliment about search engine back link and how useful are one way back link. hope this hub helps you

@fastfreta - Great to hear that, back links are web pages point back to your page website, like if you put a reference site on your hub, here you are providing back link to the particular website you are referring to, if somebody put your site on the blogs, they are providing back links to your site and it can always be one way or two way back link. The best is one way back, thanks again for stopping by


FindYourSearch profile image

FindYourSearch 6 years ago from Las Vegas, NV

Don't worry too much about linking out to other sites. Sometimes a well-placed link to an authoritative site will actually improve your site's credibility in the search engines' eyes.

Nice summary. Keep up the good work! :)

    Sign in or sign up and post using a HubPages Network account.

    0 of 8192 characters used
    Post Comment

    No HTML is allowed in comments, but URLs will be hyperlinked. Comments are not for promoting your articles or other sites.


    Click to Rate This Article
    working