Delicious Leyrer
Delicious Leyrer
Tag cloud
Daily
RSS Feed
Login
Delete
Set public
Set private
Add tags
Delete tags
Add tag
Cancel
Delete tag
Cancel
Remember me
19762
shaares
136
private links
19762
shaares ·
136
private links
Filters
Links per page
20
50
100
5 results tagged
robots.txt
The Web Robots Pages
robots.txt
·
meta-tags
·
searchengine
November 5, 2007 at 12:07:21 GMT+1 ·
permalink
·
http://www.robotstxt.org/wc/robots.html
Site Owner Help: Block your website from MSN Search Preview
robots.txt
·
meta-tags
·
searchengine
November 5, 2007 at 12:00:55 GMT+1 ·
permalink
·
http://search.msn.com.sg/docs/siteowner.aspx?t=SEARCH_WEBMASTER_PROC_PreventPreview.htm
Site Owner Help: Control which pages of your website are indexed
robots.txt
·
meta-tags
·
searchengine
November 5, 2007 at 12:00:37 GMT+1 ·
permalink
·
http://search.msn.com.sg/docs/siteowner.aspx?t=SEARCH_WEBMASTER_REF_RestrictAccessToSite.htm
Webmaster Help Center - How can I prevent content from being indexed or remove content from Google's index?
robots.txt
·
meta-tags
·
searchengine
November 5, 2007 at 12:00:15 GMT+1 ·
permalink
·
http://www.google.com/support/webmasters/bin/answer.py?answer=35301&topic=8459
Yahoo!'s Web Crawler
robots.txt
·
meta-tags
·
searchengine
November 5, 2007 at 11:59:36 GMT+1 ·
permalink
·
http://help.yahoo.com/l/us/yahoo/search/webcrawler/
Filters
Links per page
20
50
100
Fold
Fold all
Expand
Expand all
Are you sure you want to delete this link?
Are you sure you want to delete this tag?
The personal, minimalist, super-fast, database free, bookmarking service by the Shaarli community
