To prevent undesirable articles while in the search indexes, webmasters can instruct spiders not to crawl specified documents or directories from the regular robots.txt file in the root directory of the area. Additionally, a website page could be explicitly excluded from the internet search engine's databases through the use of https://news.rafeeg.ae