Important Meta Tags for making your website search engine friendly
Meta tags provide website related Information to search engines. This information helps search engines to accurately crawl, index and return your site in search results.
<meta name=”robots” content=”…, …, ….”>
This Meta tag controls how search engines crawl and index the page. The “robots” meta tag specifies rules that apply to all search engines, the “googlebot” meta tag specifies rules that apply only to Google.

• <meta name=”robots” content=”noindex”>: prevents the page from being
• <meta name=”robots” content=”nofollow”>: don’t follow links from this page when looking for new pages to
• <meta name=”robots” content=”nosnippet”>: don’t show a snippet of this page when displaying it in the search
• <meta name=”robots” content=”noodp”>: don’t use text from The Open Directory Project a.k.a. dmoz.org to generate a title or snippet for this page
• <meta name=”robots” content=”noarchive”>: don’t display a “Cached” link for this page in the search
• <meta name=”robots” content=”unavailable_after:[date]“>: remove this page from the search results after the specified date and time
• <meta name=”robots” content=”none”>:  this means NOINDEX, NOFOLLOW.
• <meta name=”robots” content=”noydir”>:  This tag tells any spider that wants to recognize the tag not to use a Yahoo Directory title or description. Of course, no other spiders do that — but Yahoo’s just building in some protection should that come up in the future
• <meta name=”Slurp” content=”noydir”>: This tag specifically tells the Yahoo spider not to use the information from Yahoo Directory.

• If you block a page with robots.txt, Googlebot will never crawl the page and will never read any Meta tags on the page.
• If you allow a page with robots.txt but block it from being indexed using a meta tag, Googlebot will access the page, read the meta tag, and subsequently not index it.