Understanding search engines

In order to better understand the concept of SEO, it is important to have a clear and precise understanding of how search engines work.

Search engines such as Google scan the internet page by page, creating a gigantic index from the pages they discover. When a search engine finds a link to another page, it follows that link and indexes the resulting page. Search engines continue to do this indefinitely, creating an ever-increasing index of web pages.

Google’s web index is well over 100,000,000 gigabytes in size and consists of trillions of pages.

When you search using Google, you are not searching "the web" as such; you are actually searching Google's enormous database of indexed of web pages. This is how Google can search through millions of sites and display the information back to you in just a couple of seconds.

When a user searches for information, the search engine uses a variety of algorithms to determine which websites are most relevant to that particular search — and which ones offer the best-quality content — before displaying a list of pages in order of relevance.


How we use search engines

People use search engines for myriad reasons — most often to shop for products and services or perform research, and sometimes purely for entertainment purposes.

Shopping and research often seem to be one and the same online. It is now commonplace for consumers to look for reviews of particular companies and products, and to compare prices between different retailers before making a decision to purchase.

Modern search engines have evolved according to the ways in which people use them. In addition to providing links to regular web pages, a typical search results page will include links to videos, images, news, maps, and even scholarly articles.

How we use search engines

Search engines as discovery tools

One of a search engine's key jobs is to identify as many web pages as possible in order to provide you with an accurate search result. To do this, it relies upon the use of automated software known as a web crawler (also referred to as Googlebot, or a spider).

Web crawlers visit web pages by following links found on other pages across the internet. They then index details about the page before following outbound links to find new pages. By continuing this process, web crawlers deployed by corporations like Google and Bing can effectively crawl and index a large portion of the internet as a whole.

Ensuring that web crawlers find your web page is one of the single most important aspects of an SEO campaign. After all, if search engines don't know you exist, they can't display your pages in search results!

How we use search engines

Building search results

The most important role of the search engine, from the point of view of the end user, is to display links to pages that are highly relevant to the search term entered.

Using information gathered by web crawlers, search engines build lists of pages that match a particular search query. This list is what the end user sees when they complete a query on a search page. There is still a lot of work, however, that goes on between the indexing of pages and displayed results. Google and other search engines use complex algorithms to help determine relevance and quality.

Google use over 200 individual factors to determine a site’s rank in the search engine results page.

Ranking sites using search algorithms

In order to display results of the highest quality and relevance, search engines use a search algorithm. This is a set of rules and mathematical equations used to determine the quality of a web page in accordance with the search term entered. The exact specifics of the algorithms are closely guarded, but it is known that Google and Bing consider hundreds of factors in their algorithms. We'll touch upon some of these factors later in this guide.


Share this page:
Follow us for great tips: