Overview
Search engines refer to search engine crawlers (also known as web spiders or web robots), which are programs or scripts that automatically scrape World Wide Web information according to certain rules.
Scenarios
When a website is accessed by search engine crawlers, it consumes server traffic and bandwidth. You can set up search engine lines specifically pointing to a server address to direct DNS requests from search engine crawlers to that server address. This effectively controls the crawling path of the crawlers.
For temporary site closure to protect SEO ranking, you can set up a dedicated line for search engines through search engine lines. This way, even though the site is shut down, spider crawlers can still normally scrape website information, thereby reducing the impact on the site's SEO ranking.
Search engine line enumeration
Primary line (line CODE) | Secondary line (line CODE) | Tertiary line (line CODE) |
Search engine (search) | Google (google) | Google_Mainland China (cn_search_google) |
Google_Overseas (os_search_google) | ||
Baidu (baidu) | Baidu_Mainland China (cn_search_baidu) | |
Baidu_Overseas (os_search_baidu) | ||
Bing (biying) | Bing_Mainland China (cn_search_biying) | |
Bing_Overseas (os_search_biying) | ||
Sogou (sougou) | Sogou_Mainland China (cn_search_sougou) | |
Sogou_Overseas (os_search_sougou) | ||
Qihu (qihu) | Qihu_Mainland China (cn_search_qihu) | |
Qihu_Overseas (os_search_qihu) | ||
Youdao (youdao) | Youdao_Mainland China (cn_search_youdao) | |
Youdao_Overseas (os_search_youdao) | ||
Yahoo (yahoo) | Yahoo_Mainland China (cn_search_yahoo) | |
Yahoo_Overseas (os_search_yahoo) |
FAQ
Why doesn't using Google browser hit the search engine line?
Answer: Search engine lines refer to the LocalDNS exit IP used by search engine crawlers, which is different from the LocalDNS exit IP used by browsers.
Why might search crawlers fail to capture the configured search engine line?
Answer: Taking Baidu crawler as an example, if the Baidu crawler server's local DNS does not use Baidu's LocalDNS, then during DNS queries, the Baidu search crawler will not be able to capture the configured search engine line.