“robots”标签的含义是什么?怎么使用它?

How do you explain to a spider of a search engine you only want it to index just the first page of your website or that it is allowed to index the whole website. You use a specific HTML meta tag the so called the meta robots tag.

<meta name="robots" content="selection">

Example how to use the meta robots tag

Add the following robots meta tag in the HTML source of your website page:

<meta name="robots" content="index, follow">

**

**

  • The spider will now index your whole website.
  • _ The spider will not only index the first web-page of your website but also all your other web-pages. _ you are also allowed to type it like this:

<meta name="robots" content="INDEX, FOLLOW">

<META NAME="robots" CONTENT="INDEX, FOLLOW">

<META NAME="robots" CONTENT="index, follow"><META NAME="robots" CONTENT="all"

By changing the index to no-index and the follow to no-follow your are able to influence the behavior of the spider. If you don't want the search engine spider to crawl through your whole website you use the following meta tag :

<meta name="robots" content="index, nofollow">**

**

  • The spider will now only look at this page and stops there.
    <meta name="robots" content="noindex, follow">**
    **

  • The spider will not look at this page but will crawl through the rest of the pages on your website.
    <meta name="robots" content="noindex, nofollow">

  • The spider will not look at this page and will NOT crawl through the rest of your web-pages.
    _
    This meta tag can also be typed with the   /  in the end of the tag:
    _
    <meta name="robots" content="index, nofollow" />
    <meta name="robots" content="noindex, follow" />
    <meta name="robots" content="noindex, nofollow" />

Where do you add this meta name robot tag?

You add this robot tag on the first index page and you tell the spider if you want your whole website to be crawled or not. Make sure that on every page relevant meta tags are added.  Add keywords and phrases that are relevant and correspond with the text and the language on that specific page. It might be a lot of work to add specific meta tags to each page but you will notice in time that it works!

以上是国外网站,对robots这个标签用法的解释,下面有翻译,用谷歌翻的,希望对大家有帮助

你如何解释您只需要它来索引您的网站,这是允许索引整个网站的第一页或搜索引擎蜘蛛。您可以使用一个特定的所谓元机器人标记的HTML META标记。

<meta NAME="ROBOTS" content="selection">

例如如何使用meta robots标记

在您的网站页面的HTML源代码中添加以下robots元标记:

<meta NAME="ROBOTS" content="index, follow">

蜘蛛现在将您的整个网站的索引。

蜘蛛不会只索引你的网站的网页,而且所有其他的web页面。

你也可以像这样类型:

<meta name="robots" content="INDEX, FOLLOW">

<META NAME="robots" CONTENT="INDEX, FOLLOW">

<META NAME="robots" CONTENT="index, follow"><META NAME="robots" CONTENT="all"

通过改变指数指数和后续无遵循的是能够影响行为的蜘蛛。如果你不想通过你的整个网站的搜索引擎蜘蛛抓取您使用下列元标记:

<META NAME="ROBOTS" content="index, NOFOLLOW">

蜘蛛,现在只能看这个页面,停在那里。

<meta NAME="ROBOTS" CONTENT="NOINDEX, follow">

蜘蛛不会看这个页面,但通过在您的网站页面的其余部分将抓取。

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

蜘蛛不会看这个页面,并不会抓取您的网站页面的其余部分通过。

这个元标记,也可以键入/标记的末尾:

<META NAME="ROBOTS" content="index, nofollow" />

<META NAME="ROBOTS" CONTENT="NOINDEX, follow" />

<META NAME="ROBOTS" CONTENT="NOINDEX, nofollow" />

你在哪里添加这个元名机器人标签?

您可以将这个机器人标签上的第一个索引页,并告诉蜘蛛,如果你想你的整个网站被抓取或没有。确保在每一页上添加相关的meta标签是。添加相关且符合特定页面上的文本和语言的关键字和词组。这可能是很多工作添加到每一页的特定元标记,但你会在时间的通知,它的作品!

2011-07-29 10:231