Everybody wants search engines to crawl their website as quickly as possible. But sometimes a situation arises when you don’t want search engines to crawl your website, for example, your website is under construction or you are working on staging website. So under these conditions, you may don’t want search engines to index your website. Because it will show your incomplete website in search results to the people who are searching for content related to your website. In this article, I will show you how to stop search engines from indexing your WordPress website.
Method to stop search engines from indexing or crawling your website
WordPress has an inbuilt feature which tells search engines not to index website. So In order to do this, you just need to go to Settings >> Reading and then you need to check to Discourage search engines from indexing this site. And then click on Save Changes button. Look at the image below for reference.
Now search engines will not be able to crawl or index your website but if in future you want search engines to index or crawl your website again, all you need to do is just uncheck above checkbox then your website will be indexed by search engines.