With the widespread growth of the World Wide Web a specially designed tool to search through the information available was developed called the search engine. Using both algorithms and human editing the search engine will present results organized in a list consisting of web pages, information, links, and images. These results are viewed by the user after inputting a keyword or keyword phrase in to the search engines search field.
A search engine uses web crawling, indexing and searching in that order to provide the most accurate results related to a particular search. Search engines work by storing information about millions of web pages that can be retrieved at the request of its user. The web crawler, or “spider,” is used as an automated web browser. It follows every appropriate visible link. The web crawler analyzes the contents of each link to determine how the pages should be indexed.
Words found inside the pages are extracted from the description and allocated appropriate meta tags. Meta tags are also taken from contents the webpage itself to establish its relevance. Data from the sites is collected, indexed and stored to be retrieved when it’s needed.
Companies such as Google store all or part of the source web page, while AltaVista stores every page word for word. The information stored and indexed is known as the cache, it allows for instant updating and keeps the searching filtered with ease. An important factor for a successful search engine is its ability to provide active and useable information with minimal to no linkrot. The cache also saves an archive of a removed source that can later be access by the user after the site is updated.
Cache storage helps in keeping track of the updates on the web page and helps in filtering. The system of indexing used by Google makes sure that only the updated contents are made available to its users by doing away with linkrot. The cache has further usage in finding the updated content that has been removed. It helps in recovering the contents as an archives source. The search process starts with a user keying in some keyword or keyword phrase, related to the content they are looking for, in the search box of an engine. The engine then uses the process of indexing to produce web pages that suit the search phrase the most. The list will include a short description of the contents that each webpage has to offer.
Many filters and specialized web crawlers create a proprietary method for analyzing web pages for results. While a keyword can be found a very large amount of websites not all sites are relevant to the users purpose and companies pride themselves on result relevancy.
Some search engines use page rankings to assist in their sifting. The search engines look at each individual page and determine through their meta tags, descriptions, keywords and content if the sites are relevant based on the key words in the search. The higher a site is ranked, the higher to the top of the results inventory it will be. The search engine sometimes uses other websites to help determine how highly a site should be ranked. If your page is linked to a higher page, it means that your page will have a higher rank in the search outcome.
