Meta tag query

[KiwiBrian]

I think I have read that there is a meta tag that can be used on a site
while under construction that will prevent it from being logged by any of
the search engines. If so, can someone tell me what it is?
Would it need to be in every page or just the root directory index page?

Thanks
Brian Tozer

 

[brucie]

In alt.html KiwiBrian said:

I think I have read that there is a meta tag that can be used on a site
while under construction that will prevent it from being logged by any of
the search engines.

in theory, you can also use robots.txt

index this page, don't follow the links:
<meta name="robots" content="index, nofollow">

don't index this page, follow the links:
<meta name="robots" content="noindex, follow">

don't index this page, don't follow the links:
<meta name="robots" content="noindex, nofollow">

index this page and follow the links:
<meta name="robots" content="index, follow">

do not cache page for SEs that have "view cached page" option.
<meta name="robots" content="noarchive">

robots.txt file: http://www.robotstxt.org/wc/robots.html

Would it need to be in every page
yes

or just the root directory index page?

use robots.txt in your root so you don't have to use the <meta> on every
page.

 

[KiwiBrian]

Thanks very much Brucie.
Very helpful answer as usual
Brian.

news:[email protected]...