Select Page

We all know the function of Google bots! They come to our site after a certain interval of time and index all the content/article present on your site. But if you don’t want to share content with google bots then what you can do? 

carton write a meta tag

Meta Tags

So here you can take the help of no index no follow meta tag to tell google and another search engine, no need to index this content.

Now you a little image of the “no index no follow meta tag” in your mind. what it can do. Ok then let me first clear it, then we move next.

Ok then let me first clear it in a more precise way. Then we move next, how to implement it and how it look like?

When I listen to this “word” first time in my life. The first word comes to my mind was “fucckkk…. what the hell are this now?”

I honestly say I don’t know an even single word about it. But after a lot of searches on the net and communicate with some expert. I finally grab the useful information that I’m still using on my blog.

What is No follow no index meta tag?

.According to rbobtstxt.org 

No index no follow meta tag is a special HTML <META> tag to tell robots(bots) not to index the content of a page, and/or not scan it for links to follow.

Let me explain in simple language

  • No index means “To tell  bots, no need to index this particular page” and
  • No follow means “To tell bots, no need to follow the link present on that page.

So combine effect of the” no index no no follow meta tag” to tell the bots that there is no need to index this post and save it into the search engine index. And also no need to follow the links present on that post. Simple just ignore it.

Why We Keep Web Pages Out of Search Results

There is a number of reasons to make sure that search engines aren’t indexing certain pages on your website. One of the most obvious use cases for marketers is “thank-you pages“.

In other words, after successfully complete the conversion you redirect your visitor to your ThankYou page where you have provided the download link of some sort of ebook or pdf.

Thankyou Page

Thankyou Page

Stopping search engines from indexing that thank you pages is necessary from time to time. For example.

You create an ebook, that you want to share with who signup your newsletter. So you place a link to that file on Thankyou page.

Suppose this Thankyou page is indexed by the google, then anyone can find this page by simply doing a quick search on Google.

So it is important to keep this page out of reach of the bots. we can do this by simply placing the no index no follow meta tag in the page source

Now, the second best example are,

if you are developing a new website, it is usually best if you block search engines from indexing your incomplete website so that your incomplete website is not listed on search engines index.

You can do this by simply

  • clicking on Read under setting Option in WordPress or blocking through a robots.txt file.

Unfortunately, WordPress does not let you stop, pages being indexed one by one.

The only option you have allows search engines to index everything or to index nothing at all. But you can use Meta Robots Tag i.e no index no follow meta tag to block specific post or page in WordPress.

Technical View Of “no index no follow meta tag”

Google advises websites owner to block URL’s using the robots meta tag. The robots meta tag i.e no index no follow meta tag follows this format are,

<meta name="value" content="value">

This tag should be placed within the <head> section of your WordPress theme header i.e. between <head> and </head>.

Note: – Replace the value with their robots and work, for example.

<meta name="robots" content="noindex">

Robots-> refers to all search engines while means all bots

noindex-> disallows the search engine to index this page.

If you want to block content from a specific search engine like Google bot, you need to replace the value of robots with the name of the search engine spider, for example

<meta name="googlebot-news" content="noindex">

Here, we block only google bots to index my content but all another search engine can index your content.

You can also block Multiple search engines spiders by separating them commas for example,

<meta name="googlebot-news,bingbot" content="noindex">

Type of other values that can be used with the content attribute.

Type of meta tag

Type of meta tag

  • index – Allow search engines robots to index the page and show a cached link in search results. you don’t have to add this to your pages, as it’s the default. as google explain in 2007, in his meta robots tag article.
  • noindex – Do not show the page in search results and do not show a cached link in search results
  • follow – Tells the search engines robots to follow the links on the page, whether it can index it or not.
  • nofollow – Tells the search engines robots to not follow any links on the page at all.
  • none – This is a shortcut for noindex, nofollow, or basically saying to search engines don’t do anything with this page at all.
  • noarchive – Do not show a cached link in search results
  • nocache – Do not show a cached link in search results
  • nosnippet – Do not show a snippet for the page in search results
  • noodp – Do not use the metadata from the Open Directory Project for titles or snippets for this page
  • noydir – Do not use the metadata from the Yahoo! Directory for titles or snippets for this page
  • notranslate – Do not offer translation for the page in search results
  • noimageindex – Disallow search engines from spidering images on that page. Of course, if images are linked to directly from elsewhere, Google can still index them,
  • unavailable_after: [RFC-850 date/time] – Do not show the page in search results after a date and time specified in the RFC 850 format

List of search engine that Supports Robots meta tag

Robots value Google Yahoo! MSN / Live Ask
index Yes Yes Yes Yes
noindex Yes Yes Yes Yes
none Yes Doubt Doubt Yes
follow Yes Doubt Doubt Yes
nofollow Yes Yes Yes Yes
noarchive Yes Yes Yes Yes
nosnippet Yes No No No
noodp Yes Yes Yes No
noydir No use Yes No use No use

How Robots Meta Tag work

Consider ebook that only can download from the Thankyou page or directly from its ULR.

sample of meta tags

Case 1: – No index tag

You add only the noindex meta tag to the page source. This tell google no need to index that page but google bots can follow the link to that page and index your ebook and anyone can downlaod directly doing a quick search in google.

Case 2: – No follow Tag

Now you only add no follow meta tag. according to this meta tag bots not follow the link but can index the your Thankyou page. So, again user can download the page by simply dong a quick search about your thankyou page.

Case 3: – no index no follow meta tag

Now bots can not index and follow your thankyou page. so your ebook is safe.

Note: – But if any user link to your Ebook then google can index your ebook from the link.

You could add a nofollow meta tag to the header of the thank you page so that search engines spider will never visit the download page. This will stop search engine spiders from crawling the page and indexing it. All you would have to do would be ensure that the thankyou page was the only area that the download page was linked from.

Implement “no index no follow meta tag” In WordPress

There is a lot of methods to implement of no index no follow meta tag in the page source. Here I’m explaining both manually and plugin method.

Manually Method

In order to block a specific post or page, you must have the ID of that Post. The easiest way to find the ID of a page or post is to edit it.

  • Login your WordPress as an Admin and Click on All Post.
  • Choose any post you want to hide from search engine and click on Edit.
post option in wordpress

Post

  • when you open the old post you will see the ID of that post in the URL.
  • The number denoted in the URL is the post ID.
Post id in wordpress

Post ID

You can block search engines from indexing that post by adding the code below to the head section of your theme’s.

Theme header.php

Theme header.php

Note: – All the theme have the different setting but the procedure remains same.  You have to only follow the step and place the code in the WordPress theme header.php

Example Code:

<?php if ($post->ID == X) { echo '<meta name="robots" content="noindex,nofollow">'; } ?> 

where X, represent the ID of the post

  • Copy the above code and paste between <head> and </head>  as shown in screenshot.
  • Just above the </head>
Add Tag in wordpres theme

Add Tag

If You to block more than one page of your website then you can use  OR operator.

<?php if ($post->ID == X || $post->ID == Y) { echo '<meta name="robots" content="noindex,nofollow">'; } ?>

You simply need to replace the X and Y with the post ID. If you want to block search engines from indexing posts and pages with ID 1748, 18 and 186. You can do this easily using,

<?php if ($post->ID == 1748 || $post->ID == 18 || $post->ID == 186) { echo '<meta name="robots" content="noindex,nofollow">'; } ?>

Verify your no index no follow meta tag  It is important to verify that you have blocked the correct pages from search engines. The simplest and easiest way to do this is to view the source of the page you are hoping to block.

If you have added the code correctly, you will see <meta name=”robots” content=”noindex,nofollow”/> listed in the head section of the page. If not, the code has not been added correctly.

  • Open that page in your chrome Browser and press Ctrl+U.
  • Now again press ctrl+f and a little search box will be open on the right top corner.
  • Enter the above code or simply nofollow code in the box.
Source Code in chrome browser

Source Code

Here you will get the string of code in your source page. That means your implementation is right.

Note: – You also need to check the source code of a page that you are not trying to block from search engines. This will verify that you have not blocked all pages on your website in accidentally.

With The Help of Plugin

The easiest and best way to block specific post or page to index is by using SEO plugin. Yoast SEO has the inbuilt function to add “no index no follow meta tag” separately in the post.

You can add no index and no follow meta tag during writing the post.

  • Click on Add new Post or Open old post and the click on Yoast SEO tab.
  • Then Click on Setting icon and add no index meta tag and no follow tag to the post, according to your choice.
Yoast plugin meta box adding noindex code

Yoast Plugin

How To Remove Page From Search Engine Results

By default, Google index all your page, so if you are now adding this code to your old post, that means google already indexed your post.

But you can remove this post from the google search engine index by using the Google URL removal Tool.

Removal option in google webmaster tool

Removal URL in Google webmaster tool

  • Copy the URL of the page and post in a box and Click continue.
  • Now click on submit.
Result of removal url webmaster iloaction

Google webmaster tool

  • You will see a status of pending, just wait for one day.

After One day or 6 hr, your post has been removed automatically. Apply the same process to another search engine where you verify your site like Bing, Yandex, Ask etc.

Recommended Post

Conclusion

“no index no follow meta tag” is not only handle the page have to be an index or not but also control the structure data of your website. Quality page and useful information in the search can increase the Domain authority and page rank of the website. So implement “no index no follow meta tag” where is a need to build a strong relationship with the search engine.

If you have any suggestion or problem about no index no follow meta tag please feel free to comment below.

Follow me

Harvinder Singh Sharry

owner at Hitechwork
I'm Professional Blogger, SEO, and Digital marketing expert. I started my blog in 2016 with the aim to share my knowledge and experiences for the people associated with my field as well as for the general public.
Follow me
Subscribe To Our Newsletter

Subscribe To Our Newsletter

Join our mailing list to receive the latest news and updates from our team.

You have Successfully Subscribed!

Pin It on Pinterest

Shares
Share This