Unavailable_After, what it is for and when to use it




Google definition for the Unavailable_After meta tag:

Do not show this page in search results after the specified date / time. The date / time must be specified in a widely adopted format including, but not limited to RFC 822, RFC 850, and ISO 8601. The directive is ignored if no valid [date / time] is specified. By default there is no expiration date for content.

several practical scenarios for the unavailable_after tag. The most obvious is for tests and limited time online pages . For example, suppose you have published a page with offers that expire on a certain date. The unavailable_after tag allows you to define when an indexed page on your website should disappear from Google results.

Other practical cases? Suppose you have an event webpage, which links to a different event page each week. Or post jobs that are only available for one month. Pages like these, which show a limited-time offer or event , are great examples of pages you wouldn't want Google to crawl frequently after a certain date.

Google has also added support for controlling access to non-HTML documents that cannot contain meta tags for blocking, such as PDF files, audio, xls documents, and so on. This is done via a new X-Robots-Tag directive issued via the HTTP header used to serve the file.

Large-scale utility?

The unavailable_after tag could help the budget crawl of large news sites with hundreds of thousands of pages and articles maybe 10 or more years old. In fact, by carefully using this tag on indexed but outdated content, Googlebot will not crawl that content as often, allowing the most important pages to take up the majority of the site's crawl budget.

It is important to note that this meta tag should not be used for pages with evergreen content. Just because a page's content doesn't change over time doesn't mean it doesn't need to be crawled regularly. This tag should only be used for pages that are no longer important and shouldn't rank in search results.

Info Giovanni Sacheli

My name is Giovanni Sacheli , I am a Consultant in Search Marketing (SEO and PPC) and I work in my agency Searcus Swiss Sagl. Co-author of the book SEO Audit Advanced , passionate about technical SEO analysis and campaigns with Google Ads. Since 2010 I have been sharing SEO guides and technical notions for consultants, webmasters and professionals in this blog.SEO services in Pakistan.





Comments

Post a Comment

Popular posts from this blog

ABOUT BASIC SEO TECHNIQUES

Image
The Basic SEO Techniques category has been prepared to explain in detail many basic SEO strategies that you need to know and will benefit you when you apply them. As we mentioned in our previous articles, the issue of creating an effective blog or website that gets traffic will be examined in a separate category in SEO  Pakistan. On the other hand, the information we will share with you in the Basic SEO  services in pakistan will be a roadmap for the mentioned section. In this category, you will find many articles and valuable information under the headings of on-page SEO (on-page SEO) and off-page SEO (off-site SEO). For example, the things you need to pay attention to when registering with search engines, the control of the links from our site, the subtleties of adding links to the directories, the use of social media while entering off-page techniques, the meta tag structure, keyword density, and the issue of creating up-to-date content. They are good examples of on-page ...
Read more

Corporate SEO Service

Image
   Corporate SEO Service SEO studies are one of the studies and sectors whose demand and competition are increasing the most. When this is the case, the SEO industry can be a focal point by different thought groups and become vulnerable to abuse. Those who enter the sector with such different intentions pose a great risk and trust problem for SEO works. In this case, corporate companies are much more careful and anxious for SEO work. Corporate SEO studies include areas other than generic words. For example, the game covers works on elevator, parquet or directly on the name of the company, instead of the news word. For example, there are sector groups according to the region such as Istanbul elevator repair, Mersin cleaning company among corporate SEO works. Another factor for corporate SEO work is that it must be a company. Invoicing for the work done is an indispensable issue for teamwork, detailed reporting, and more assurance. Things to Consider in Corporate SEO Company Sel...
Read more

Install an SSL certificate with Certbot on Ubuntu and Nginx

Image
Certbot is an easy-to-use client that retrieves and distributes Let's Encrypt SSL / TLS certificates , thus enabling encrypted HTTPS on your web server. Certbot was developed by the Electronic Frontier Foundation EFF and others as a client for Let's Encrypt. You can read more about Certbot or Let's Encrypt, respectively. Do you run a web server with SSH access and want to install a free SSL certificate on the websites it hosts? You are in the right place, let's see how to secure your website using Certbot ACME on Nginx and Ubuntu . Premises To enable HTTPS on your website, you need to obtain a certificate (a type of file) from a certification authority (CA). Let's Encrypt is a CA. To get a certificate for your website's domain from Let's Encrypt, you need to demonstrate control over the domain. With Let's Encrypt, you do this using software that uses the ACME protocol which usually runs on your web host. To figure out which method will work best for you,...
Read more