Blogger has a variety of URL representations, for example for Archives and Posts. A post will get a URL format like .../year/month/post.html, if we omit /post.html, then it will be .../year/month an Archive page. Each page can generally be accessed by a bot then processed by it, such as for example a Google bot can index the page and then display it on its search engine.
Because each page can be accessed, it is possible that we will find duplicate content. Just say, an article titled "Foo go to Bar" with the URL form "/2018/10/foo.html" will also be found in the "2018/10" Archive Page. On the Google search engine, this can affect the display of 2 content, which is often called a duplicate. For example, we search for the title "Foo go to Bar" in Google search, maybe we will get 2 results from our Blog with 2 different URLs, one of which is the Post Article Link with title Foo go to Bar and the other one is the Archive page Link with title BlogTitle: 10/1/18 - 11/1/18 with the description "Foo go to Bar" inside or showing same description in every Archive Link. Try to search your Blog with keyword site:BLOG-URL example, site:example.blogspot.com.
| Expression | URL Format | Meaning |
|---|---|---|
| data:view.isHomepage | / | Homepage |
| data:view.isPage | /p | Static Page |
| data:view.isArchive | /2018 or /2018/11 | Page List of post from the current year or month |
| data:view.isPost | /2018/11/foo.html | Post Article Page |
| data:view.isSearch | /search | All URL has a word 'search' |
| data:view.isLabelSearch | /search/labelname | Page list of Post with 'labelname' |
| data:view.search.query | /search?q=keyword | Blog Search Result Page. |
To avoid this duplication, we cannot use the Custom Robot.txt feature as we forbid robots from accessing the label page section by entering "Disallow: /search/LabelName" because if we enter "Disallow: /2018/10" this will generalize all that is inside that section will be prevented from accessing, this includes our posting page, like the example "foo.html", another problem also that "/year/month/" will definitely become a lot as the age of our Blog increases. from that, the solution is to use the <meta> tag for Robot.
Meta Tags for Robots Search Engine Crawlers
The Meta robot tag is a tag that will tell the Search engine how it should handle a page. This tag is located in the <head> tag section of a page.
SYNTAX
<meta name='robots' content='ATTRIBUTE'/>
| Attribute | |
|---|---|
all | Allow All, mean no restrictions for indexing or serving, like Allow index, allow follow, etc. |
noindex | Don't show this page in search results. |
nofollow | Don't follow the links on this page. |
none | Equivalent to noindex, nofollow. |
noarchive | Don't show a "Cached" link in search results. |
nosnippet | Don't show a text snippet or video preview in the search results for this page. |
notranslate | Don't offer translation of this page in search results. |
noimageindex | Don't index images on this page. |
unavailable_after: [RFC-850 date/time] | Don't show this page in search results after the specified date/time. The date/time format must be specified in the RFC 850 format. |
There are 2 ways in Blogger to provide meta tags for robots, manually and automatically.
Custom Robots Header Tags
This is an automated way to provide meta tags on a page. There are 3 sections here, Homepage, Archive and Search Page, Post and Page.
- Inside the Blogger Dashboard select 'Settings'.
- Select 'Search preferences'.
- See the 'Crawlers and indexing' section.
- Click 'Edit' in the 'Custom Robots Header Tags' section.
- Choose 'yes' to enable this feature.
- Select the desired option.
- Save.
Seen from the section, Archive And Search Page is in the same part, if we want to only provide the meta tag for the Archive page, then we have to use the manual method.
Manually Adding Meta Robots Tag in Blogger
The manual method can be done by giving a code for the meta tag. For example, we give a condition to only display the Meta Robots Tag on the Archive page, we can insert the code below between the tags <head> and </head>.
WITH THE <B:IF> TAG
Blogger , Tips and Tricks<b:if cond='data:view.isArchive'>
<meta content='noindex,noarchive' name='robots'/>
</b:if>
