All existing search systems. What search engines are there?

Most popular web The search engine is the service of our time. Everything is understandable here, because the days when representatives of the first Internet users could observe new products on the Internet are long gone.

So much information appears and accumulates that it has become very difficult for a person to find exactly what he needs. Imagine what it would be like to search on the Internet if the average user had to look for information from God knows where. Just don’t understand where, because you won’t find much information with a manual search.

Search engine, what is it?

It’s good if the user already knows sites that may have the necessary information, but what to do otherwise? In order to make life easier for a person when searching for the necessary information on the Internet, they were invented search engines or just search engines. The search engine performs one very important function, without which the Internet would not be the same as we are used to seeing it - this is searching for information on the Internet.

Search engine- this is a special web site or in other words a site that provides users, upon their requests, with hyperlinks to pages of sites that respond to a given search query.

To be a little more precise, it is a search for information on the Internet, carried out thanks to a software and hardware functional set and a web interface for interacting with users.

For human interaction with the search engine, a web interface was created, that is, a visible and understandable shell. This approach of search engine developers makes searching easier for many people. As a rule, it is on the Internet that searches are carried out using search engines, but there are also search systems for FTP servers, certain types of goods in world wide web, or news information or other search directions.

The search can be carried out not only by the text content of sites, but also by other types of information that a person can search for: images, videos, sound files etc.

How does a search engine search?

Searching the Internet itself, just like browsing websites, is possible using an Internet browser. Only after the user has specified his query in the search bar, the search itself is carried out directly.

Any search engine contains software part, on which the entire search mechanism is based, it is called a search engine - it is a software package that provides the ability to search for information. After contacting a search engine, a person generates a search query and enters it into the search bar, the search engine generates a page with a list of search results, the most relevant ones, in the opinion of the search engine, are located higher.

Search relevance - searching for the most relevant materials to the user's request and placing hyperlinks on them on the search results page with more accurate results above others. The distribution of results itself is called site ranking.

So how does a search engine prepare its materials for publication and how does the search engine itself search for information? The collection of information on the network is facilitated by a unique robot or bot for each search engine, which also has a number of other synonyms such as crawler or spider, and the work of the search system itself can be divided into three stages:

The first stage of a search engine’s operation includes scanning sites in global network and collecting on your own own servers copies of web pages. This creates a huge amount of information that has not yet been processed and is not suitable for search results.

The second stage of the search engine’s work comes down to putting in order the information received earlier, in the first stage, from sites. The sorting is carried out in such a way that in the least amount of time will be conducive to the very high-quality search that users actually expect from a search engine. The stage is called indexing, which means that the pages are already prepared for issuance, and the current database will be considered an index.

It is precisely the third stage that determines search results, after receiving a request from your client, relying on the keywords or near keywords specified in the request. This facilitates the selection of the information most relevant to the request and its subsequent delivery. Since there is a lot of information, the search engine performs ranking in accordance with its algorithms.
The best search engine is considered to be the one that can provide the material that most correctly responds to the user’s request. But here, too, there may be results that were influenced by people interested in promoting their site; such sites, although not always, often appear in search results, but not for long.

Although world leaders have already been identified in many regions, search engines continue to develop their high-quality search. The better the search they can provide, the more people will use it.

How to use the search engine?

What is a search engine and how it works is already clear, but how to use it correctly? Most sites always have a search bar, and next to it there is a Find or Search button. A query is entered into the search line, after which you need to press the search button or, as is more often the case, press the Enter key on the keyboard and in a matter of seconds you receive the result of the query in the form of a list.

But it’s not always possible to get the correct answer to a search query the first time. To ensure that the search for what you want does not become painful, you must correctly compose your search query and follow the recommendations described below.

We compose the search query correctly

The following will provide tips for using the search engine. Following some tricks and rules when searching for information in a search engine will make it possible to get the desired result much faster. Follow these guidelines:

Correct spelling of words ensures the maximum number of matches with the search term information object(Although modern search engines have already learned to correct spelling errors, this advice should not be neglected).
By using synonyms in your query, you can cover a wider search range.
Sometimes changing a word in the query text can bring better results; reformat the query.
Bring specificity to your query, use exact occurrences of phrases that should define the main essence of the search.
Experiment with keywords. Usage keywords and phrases can help determine the main point, and the search engine will return a more relevant result.

So what a search engine is is nothing more than an opportunity to find information of interest and usually use it completely free of charge, learn something, understand something, or draw the right conclusion for yourself. Many people can no longer imagine their life without voice search, in which you don’t have to type text, you just need to say your request, and the information input device here is a microphone. All this indicates the constant development of search technologies on the Internet and the need for them.

Search engines are considered the most popular sites on the Internet. This is not surprising, because to find something on the Internet, you first have to use search services.

There are quite a lot of them and not even experienced users Internet, know at least 2-3 search engines.

What search engines are there? Some people know about one search engine, some people know about 10 search services, but in reality there are many more.

Of course, their popularity varies, as does the interface and the quality of the results. We will present you with a list from different search engines so that you can compare them.

Popular search engines

Search services have been developed for various categories of people. The most famous ones cover countries or even the whole world, while the lesser known ones are designed for regions or user interests.

Below are 10 search engines you should know about:

– everyone knows about this search engine, it is the most popular in Russia and provides a wide range of functionality to its users (from electronic payments to a panel for webmasters).
– the leader among all sites in the world. It is used by people from all over the world and is considered the highest quality search engine. Like Yandex, clients are offered many additional tools.
– search and information system, taking into account Russian-language morphology. The site has several separate versions, for example, XRambler, through which you can search in several services at once.
– This system is extremely popular abroad. It was translated into Russian a long time ago, but it never received much fame on the Runet. Users have access to various searches (by pictures, videos, etc.).
is a well-known company in Runet, engaged in development in several directions at once. In addition to their own search engine and the most popular mail service, they are the owners of such projects as Odnoklassniki and Vkontakte.
– was created as a state resource in Russia, but did not receive mass distribution. You can pass through it different formats search and receive useful information.
– designed to search for information on the Chinese segment of the Internet. Who knows, maybe this will be useful to you. You can receive news, search for pictures, music, receive maps and much more.
is a project of the well-known company Microsoft. In terms of traffic volume, this site ranks second in the world search engine rankings. It has been operating since 1998 and has been modernized many times during this time.
– this service is used only by foreigners. The project is American and in addition to the search engine, the company has a lot of other sites and services. It is worth noting that they have the largest catalog of links to sites on the World Wide Web.

If you can’t find information in one of the search engines, then why not look for it through another site? Now you have several quality resources, you're sure to find what you need.

17.12.2017 17:00:00

Modern Internet It’s hard to imagine without search engines. Every day they process billions of requests coming through desktop browsers and mobile applications. The most complex algorithms literally predict user actions, suggest possible options for input data, and produce the most accurate results.

But what is the best search engine operating on the Internet today? Why do we prefer a particular search engine? In our article we will analyze which search engines have gained the most popularity and what are their fundamental differences.

Ranking of search engines in the world

First, let's find out which search engines are the most popular in the world. To do this, let’s turn to the data provided by the reputable analytical agency NetMarketShare. This table shows the top 5 search engines and the percentage of user requests personal computers for 2017:

It is easy to see that in both positions the Google search engine is leading by the widest margin from its competitors. Moreover, for mobile Google devices, in fact, is a monopolist, processing 93% of all search queries. This is also due to the widespread use of smartphones running Android OS.

In addition, Google is one of the most minimalistic search engines. On the main page, the user sees only a logo and a search bar. Users are also attracted to interesting doodles - Google logos that are redrawn in honor of a certain date or event. Very often such doodles are made interactive. Thus, according to all the above indicators, Google is clearly the best search engine.

In second place in popularity, both on PCs and on smartphones, is the Chinese search engine Baidu. The fact is that this service is the only one available in China - it is used by 92% of the entire population. From time to time, Baidu tries to expand its geographic boundaries, but it has never gained popularity in other countries. This is largely due to a rather aggressive promotion policy and a conflict between search engine extensions and antivirus software.

Bing is a search engine from Microsoft that is most often used by PC owners in the United States. A small percentage of requests with mobile devices due to the fact that smartphones from Microsoft are gradually leaving the market.

Yahoo! is one of the oldest search engines, which was created in 1995. It is mainly used by residents of the USA, Great Britain and some countries of Southeast Asia.

The search engine from Yandex was only in the top five for queries from a PC. A small percentage of the total number of requests is also due to the fact that the domestic search engine is used by users in Russia and the CIS countries. And the Dogpile service closes the top 5 in terms of popularity of search engines for mobile devices. Its main audience is residents of the USA, Canada and Europe.

Search engine rankings in Russia

Data from the LiveInternet counter and the Seo-auditor analytical service will help us find out which is the best search engine in the Russian Internet segment of the Runet.

The LiveInternet counter takes into account search queries from both PCs and mobile platforms. As a result, the popularity rating of search engines in Russia looks like this:

The two main competitors, Google and Yandex, are leading by a wide margin. Both search engines are different high speed and work efficiency. In addition, each service has its own unique features. For example, the Google search engine provides clear and concise information about each site, and also takes into account the quality of pages in the results. Yandex pays great attention to its additional services, which are connected with every request in the search engine.

In third place in popularity was the search engine from Mail.ru. Many experts note that of this service well-developed search algorithms, fast update news on the main page. On the other hand, Mail has plenty of shortcomings. First of all, there is a shortage additional services and an unfinished anti-spam filter.

The once popular Rambler now processes only 0.2% of the total number of search queries on the RuNet. Some time ago, the service made a major overhaul: the search engine changed its logo and was redrawn from scratch home page. However, this, unfortunately, did not help to rise in the search engine rankings.

Nevertheless, Rambler has its obvious advantages. For example, an associative search system. If the user forgets to change the layout and types in the word vepsrf, the search engine returns results for the query “Music”. Now this system will not surprise anyone, but Rambler was the first search engine on the RuNet that was able to implement such an algorithm in a high-quality manner.

The Bing search engine processed less than 200 thousand requests per year. As mentioned above, the service from Microsoft is popular mainly in the West, and, most likely, most of the requests on the RuNet via Bing are sent from smartphones and PCs of foreigners working in Russia.

Similar data on the popularity of search engines can be observed in a study by the analytical agency Seo-auditor. Compare the figures for January and November 2017:

Having compared data from Yandex.Metrica, SpyLog/Openstat, LiveInternet, Hotlog, [email protected] counters, as well as using original algorithms, Seo-auditor specialists came to the conclusion that the title of “Best Search Engine” in RuNet is again shared among themselves Google and Yandex. In addition, it is noticeable how the share of requests through the search engines Mail, Rambler and Bing has decreased over the year.

Mobile search engine applications

Among the top five most popular search engines, Google, Yandex and Bing have branded mobile applications. To find out how each utility differs, we tested search engines on a powerful and productive smartphone. As a test request, we used one of the most popular ones, on at the moment, not only in Russia, but throughout the world - Star Wars 8. The result can be seen in the video below:

Google in its mobile search engine is guided by the same principle as in the desktop version - a minimum of interface elements. The search query can be entered either with on-screen keyboard, and by voice. In the search engine results, you can trace a clear hierarchy:

Reviews and ratings of the film
Showtimes in city cinemas
Trailers on YouTube
List of film actors
Related queries
Links to sites.

A similar picture can be seen in the Yandex search engine. Russian service in its application also copies the main version. On the main page there are useful services and news, and the search bar is fixed at the bottom of the screen. The results are distributed as follows:

Trailers and videos on Yandex.Video
Cinema show times
Link to Wikipedia
List of actors
Related queries
Links to the site (and the first link is the film’s page on Kinopoisk, which belongs to Yandex).

A separate “trick” of Yandex can be called voice assistant Alice, with which you can not only find necessary information, but also to pass the time in a pleasant, and sometimes funny conversation with a digital algorithm.

The Bing app, like Google, follows the path of brevity. On the main screen there is a search button on beautiful background. By clicking on the magnifying glass, the user is taken to the search engine page. Despite the fact that the interface is not Russified, the application quickly displays desired results. True, unlike Google and Yandex, Bing is limited to only links to sites without additionally included services.

Alternative search engines

Besides the most popular search engines like Yandex and Google, there are many interesting search services, which in terms of their functions can become a good alternative to the recognized giants. We have selected 5 of the most interesting systems that can be used both on PCs and smartphones.

A search engine that is based on three main principles:

No personal data storage
Absence intrusive advertising based on user requests
Lack of tracking of user actions.

Thus, DuckDuckGo will be appreciated by those who prefer privacy on the Internet and want to receive objective information, without taking into account past Internet search behavior. In addition, DuckDuckGo is not geographically tied to the user. This means that information can be searched and received in any language, while Yandex and Google give preference to Russian-language resources, even if you enter a query in English.

YaCy

A decentralized search engine that does not have a single server and owner. YaCy is a network of user computers on which it is installed special program. Each PC independently scans the Network and collects the information received into a common database. Each node in the YaCy network is autonomous and therefore not subject to government or corporate censorship.

The only drawback for domestic users is that YaCy is not Russified.

Pipl

Pipl is a system that is designed to search for specific users on the Internet. Complex algorithms collect all the data about a person from social network profiles, comments, open databases, and so on. At the moment, in search database Pipl has collected data from more than 3 billion people.

Searching the RuNet for Pipl is still quite a difficult task. So this search engine will be more useful to those who are looking for specific users in Europe, the USA or Canada.

Question-answering system, search engine based on a knowledge base and a set of computational algorithms. Unlike other search engines, Wolfram|Alpha does not display a list of links for queries, but generates a complete answer based on a knowledge base about history, culture, science, cinema, theater and much more. In addition, the algorithm connects data about famous people and pages on the Internet.

For example, when asked for Star Wars films, the search engine returns a list of all films in the cinematic universe, for each of which you can view an individual information card. Following is a selection of movie posters and detailed information about box office receipts in cinemas.

Wolfram|Alpha is constantly updating its database to provide more accurate results. necessary information upon request. For students, journalists, analysts and researchers, Wolfram|Alpha is perhaps the best search engine, as it returns not only text information, but also compiles various graphs, tables and diagrams for greater clarity.

We introduced you to the most popular search engines. Of course, it is quite difficult to call a certain search engine the best in the world. Each system has its own set of tools that attract certain users. Which search engine do you use most often? Tell us about your impressions in the comments to this article!

Good day to everyone, my dear friends and readers of my blog. Today I want to tell you about the most famous search engines on the Internet in Russian. Internet resources are used for the daily work and leisure of a huge number of people.

And in order to get what is needed or interesting, search engines are used, which are a hardware and software complex for quick search information required by the user stored on servers ( special computers) Internet.

The frequency of use of a search engine is determined, firstly, by how relevant the data it provides, and secondly, by how quickly it does so. The main selection criteria are:

completeness and accuracy of the results found;
data relevance;
finding speed;
clarity of the interface.

In Russia, the most popular search engines are Yandex, Mail, Rambler and some others. But I would like to provide you with a more detailed list of these systems so that you have a more complete understanding of all this.

Yandex.ru is the most popular within the Russian-language Internet. Search queries can be written in both English and Russian. The motto of the Yandex website is “Everything can be found!” and indeed, they are provided with high-quality and fast provision of information.

Personally, I have been using this search engine by default for more than 10 years and I really like it. And for any webmaster it is simply of great importance, since any of them will work hard to ensure that their site is found in this particular system.

It has a huge index base, which means it can find almost everything. The conclusion of the information found is rational. Yandex is constantly developing. It offers more and more popular services, such as news, maps, weather forecast, e-mail, Yandex. money. By the way, I wrote here, so if you are interested in this, be sure to read it.

Currently, the share of Yandex use in Russia is about 56 percent. That is, the majority of the country's population prefers to use this particular browser.

Google

And here is the main competitor of the aforementioned Yasha. Yes, this system is certainly not Russian, but one of its founders is our compatriot Sergei Brin. True, he was taken to the states while still a child, so he can hardly be called Russian. If you are interested, then you can read the ones I have collected for you.

Be that as it may, Google is the most popular system in the world and is still the second most popular in Russia.

For today 38 percent All search queries in Russia go through Google

Search Mail.ru

Mail.ru is very popular among Russian-speaking network users. But not many people use the search engine of the same name. By itself, it is ordinary and unremarkable, so it cannot yet withstand competitors such as the aforementioned Yandex and Google. Although I doubt that he will try to conquer the top of search engines. It is enough for him that he has the most popular post office in Russia. But still ours 5 percent of the total number of requests it has.

In addition, the site contains a huge number of applications, interesting games, and also has its own social network. Applications have been developed that allow searching by voice.

Rambler.ru

Rambler is one of the earliest options and used to be one of the most popular search engines in the Russian language, along with Yandex. And for the first couple of years I actively used it as the default search engine, until I switched to Yandex. Now it is not used very actively (I would even say not actively at all), although it has good quality and excellent speed.

It is also a popular RuNet media portal where you can use mail, find out latest news about various areas of life. By the way, it has proven itself quite well as a media and news portal, and I know many people who specifically go to Rambler to read the latest news.

Despite its former popularity, Rambler today owns less 0.5 percent of the total number of requests on the Internet.

WebAlta.ru

WebAlta is one of the new Russian search engines. It is developing well and already reflects more than 1 billion documents, which is good result. It is easily customizable according to users' preferences. The setting is visualized, and changing the query is immediately reflected in the results.

But how it annoyed me a couple of years ago, when after installing some application, Webalta got up as home page and default search engine. I actually thought it was some kind of virus. Therefore, I will say again: “”.

Well, I won’t even talk about the share of search traffic, since it is negligible.

Nigma.ru

Nigma is a modern Russian intelligent metasearch system. It uses a modern cluster approach, which improves the quality and completeness of the process. The site includes mathematical and chemical subsystems for solving the most different tasks and standard user services.

But so far this is probably the least popular service of all those presented above. Although you can try it in action. Perhaps you will like everything). Well, as far as you understand, the traffic here is also so low that you don’t even have to turn it on.

Please tell me what search engines you use? I'm asking for a reason. The fact is that I recently found out that one of my friends uses Rambler. And to be honest, I was surprised that some of my friends did not use Yandex or Google. I’ve just been hooked on Yandex since the mid-2000s and it is my favorite search engine.

Well, now, in principle, I think that you, in principle, know all the main search engines in Russian, and draw conclusions about which one is more interesting to you. But it’s true that it will be difficult for others to compete with two giants

Well, this is where I’ll probably finish my article today. I hope you liked it. If so, then be sure to visit me again. Good luck to you. Bye!

Sincerely, Dmitry Kostin.

Hello, dear readers of the blog site. , then its few users had enough of their own bookmarks. However, as you remember, it happened in geometric progression, and very soon it became more difficult to navigate in all its diversity.

Then directories appeared (Yahoo, Dmoz and others), in which their authors added and sorted various sites into categories. This immediately made life easier for the then, not yet very numerous users of the global network. Many of these catalogs are still alive today.

But after some time, the size of their databases became so large that the developers first thought about creating a search within them, and then about creating automated system indexing all Internet content to make it accessible to everyone.

The main search engines of the Russian-speaking segment of the Internet

As you understand, this idea was implemented with stunning success, but, however, everything turned out well only for a handful of selected companies that managed not to disappear on the Internet. Almost all search engines that appeared in the first wave have now either disappeared, languished, or were bought by more successful competitors.

A search engine is a very complex and, importantly, very resource-intensive mechanism (this means not only material resources, but also human ones). Behind the seemingly simple , or its ascetic analogue from Google, there are thousands of employees, hundreds of thousands of servers and many billions of investments that are necessary for this colossus to continue to operate and remain competitive.

Entering this market now and starting from scratch is more of a utopia than a real business project. For example, one of the world's richest corporations, Microsoft, has been trying to gain a foothold in the search market for decades, and only now their search engine Bing is slowly beginning to meet their expectations. And before that there was a whole series of failures and setbacks.

What can we say about entering this market without any special financial influences. For example, our domestic search engine Nigma has a lot of useful and innovative things in its arsenal, but their traffic is thousands of times lower than the leaders of the Russian market. For example, take a look at the daily Yandex audience:

In this regard, we can assume that the list of the main (best and luckiest) search engines of the Runet and the entire Internet has already been formed and the whole intrigue lies only in who will eventually devour whom, or how their percentage share will be distributed if they all survive and will stay afloat.

Russian search engine market is very clearly visible and here, probably, we can distinguish two or three main players and a couple of minor ones. In general, a rather unique situation has developed in RuNet, which, as I understand it, has repeated itself only in two other countries in the world.

I'm talking about the fact that the Google search engine, having come to Russia in 2004, has still not been able to take the lead. In fact, they tried to buy Yandex around this period, but something didn’t work out there and now “our Russia”, along with the Czech Republic and China, are those places where the almighty Google, if not defeated, then, in any case, met serious resistance.

In fact, to see the current state of affairs among the best search engines Runet Anyone can. It will be enough to paste this URL into the address bar of your browser:

Http://www.liveinternet.ru/stat/ru/searches.html?period=month;total=yes

The fact is that most of them use .

After entering the given Url, you will see a picture that is not very attractive and presentable, but it well reflects the essence of the matter. Pay attention to the top five search engines from which sites in Russian receive traffic:

Yes, of course, not all resources with Russian-language content are located in this zone. There are also SU and RF, and general areas like COM or NET are full of Internet projects focused on Runet, but still, the sample is quite representative.

This dependence can be presented in a more colorful way, as, for example, someone did online for his presentation:

This doesn't change the essence. There are a couple of leaders and several very, very far behind search engines. By the way, I have already written about many of them. Sometimes it can be quite interesting to plunge into the history of success or, conversely, to delve into the reasons for the failures of once promising search engines.

So, in order of importance for Russia and the Runet as a whole, I will list them and give them brief characteristics:

Searching on Google has already become a household word for many people on the planet - you can read about it in the link. In this search engine, I liked the “translation of results” option, when you received answers from all over the world, but in your native language, but now, unfortunately, it is not available (at least on google.ru).

Also in lately I am also puzzled by the quality of their output (Search Engine Result Page). Personally, I always first use the RuNet mirror search engine (there is one there, well, I’m used to it) and only if I don’t find an intelligible answer there, I turn to Google.

Usually their release made me happy, but lately it has only puzzled me - sometimes such nonsense comes out. It is possible that their struggle to increase income with contextual advertising and constant shuffling of issues in order to discredit SEO promotion may lead to the opposite result. In any case, this search engine has a competitor on the RuNet, and what kind of one at that.

I think that it is unlikely that anyone will specifically go to Go.mail.ru to search in RuNet. Therefore, traffic to entertainment projects from this search engine can be significantly more than ten percent. Owners of such projects should pay attention to this system.

However, in addition to the clear leaders in the search engine market of the Russian-language segment of the Internet, there are several more players whose share is quite low, but nevertheless the very fact of their existence makes it necessary to say a few words about them.

Runet search engines from the second echelon

Internet-wide search engines

By and large, on the scale of the entire Internet there is only one serious player - Google. This is the undisputed leader, but it still has some competition.

First of all, it's still the same Bing, which, for example, has a very good position in the American market, especially considering that its engine is also used on all Yahoo services (almost a third of the entire US search market).

Well, secondly, due to the huge share that users from China make up in the total number of Internet users, their main search engine called Baidu wedges itself into the distribution of places on the world Olympus. He was born in 2000 and now his share is about 80% of the entire national audience in China.

It is difficult to say anything more intelligible about Baidu, but on the Internet there are opinions that places in its Top are occupied not only by the sites most relevant to the request, but also by those who paid for it (directly to the search engine, and not to the SEO office). Of course, this applies primarily to commercial listings.

In general, looking at the statistics, it becomes clear why Google easily agrees to worsen its search results in exchange for increasing profits from contextual advertising. In fact, they are not afraid of user churn, because in most cases they have nowhere to go. This situation is somewhat sad, but we'll see what happens next.

By the way, to make life even more difficult for optimizers, and perhaps to maintain peace of mind for users of this search engine, Google has recently used encryption when transmitting queries from users’ browsers to the search bar. Soon it will no longer be possible to see in the statistics of visitor counters what queries Google users came to you for.

Of course, in addition to the search engines mentioned in this publication, there are thousands of others - regional, specialized, exotic, etc. Trying to list and describe them all in one article would be impossible, and probably not necessary. Let's better say a few words about how easy it is to create a search engine and how it’s not easy or cheap to keep it up to date.

The vast majority of systems work on similar principles (read about this and that) and pursue the same goal - to give users an answer to their question. Moreover, this answer must be relevant (corresponding to the question), comprehensive and, what is not unimportant, relevant (of the first freshness).

Solving this problem is not so easy, especially considering that the search engine will need to analyze the contents of billions of Internet pages on the fly, weed out the unnecessary ones, and from the remaining ones form a list (issue), where the most appropriate answers to the user’s question will appear first.

This extremely complex task is solved by preliminary collection of information from these pages using various indexing robots. They collect links from already visited pages and load information from them into the search engine database. There are bots that index text (a regular and fast bot that lives on news and frequently updated resources so that the latest data is always presented in the results).

In addition, there are robots that index images (for their subsequent output to), favicons, site mirrors (for their subsequent comparison and possible gluing), bots that check the functionality of Internet pages, which users or through tools for webmasters (here you can read about, and) .

The indexing process itself and the subsequent process of updating index databases are quite time-consuming. Although Google does this much faster than its competitors, at least Yandex, which takes a week or two to do this (read about).

Typically, a search engine breaks the text content of an Internet page into individual words, which leads to the basic principles, so that you can then give correct answers to questions asked in different morphological forms. All excess body kit in the form HTML tags, spaces, etc. things are deleted, and the remaining words are sorted alphabetically and their position in this document is indicated next to them.

This kind of thing is called a reverse index and allows you to search not by web pages, but by structured data located on the search engine servers.

The number of such servers for Yandex (which searches mainly only for Russian-language sites and a little for Ukrainian and Turkish) is in the tens or even hundreds of thousands, and for Google (which searches in hundreds of languages) - in the millions.

Many servers have copies, which serve both to increase the security of documents and help increase the speed of request processing (by distributing the load). Estimate the costs of maintaining this entire economy.

The user's request will be sent by the load balancer to the server segment that is currently least loaded. Then an analysis is carried out of the region from which the search engine user sent his request, and a morphological analysis is made of it. If a similar request was recently entered into search bar, then the user is given data from the cache so as not to overload the servers.

If the request has not yet been cached, then it is transferred to the area where the search engine's index database is located. In response, you will receive a list of all Internet pages that are at least somewhat related to the request. Not only direct occurrences are taken into account, but also other morphological forms, as well as, etc. things.

Their needs to be ranked and at this stage the algorithm comes into play ( artificial intelligence). In fact, the user's request multiplies at the expense of everyone possible options its interpretation and answers to many queries are sought simultaneously (through the use of query language operators, some of which are available to ordinary users).

As a rule, the search results contain one page from each site (sometimes more). are now very complex and take into account many factors. In addition, to correct them, and are used, which manually evaluate reference sites, which allows you to adjust the operation of the algorithm as a whole.

In general, it is clear that the matter is dark. We can talk about this for a long time, but it is already clear that user satisfaction with a search system is achieved, oh, how difficult it is. And there will always be those who don’t like something, like you and me, dear readers.

Good luck to you! See you soon on the pages of the blog site

You can watch more videos by going to

");">