erzanajones
Posted 2007-07-20 08:06:36
Can any one tell me about Robots.txt ?
Best Dentist Manhattan And
Oral Surgeon New York
weblaunchphxx
Posted 2007-08-10 12:47:43
Robots.txt is a file that tells spider not to crawl that page in which robots.txt is placed.
Grapihic design Search engine optimization[Edited by weblaunchphxx on 2007-09-10 09:32:38]
shanehadson
Posted 2007-09-26 15:01:05
I think that rohbots.txt is a file used to keep web pages from being
indexed by search engines. The Robots Exclusion page provides official details.
I think it is useful for u.
Accounting outsourcing and
Bookkeeping Help
aidan.tristan
Posted 2007-09-27 12:49:20
Robots.txt allows for SEO\'s to control the actions of search engine spiders on the site or even deny them access.
California reverse mortgage and
Reverse mortgage seniors
michellebarkley
Posted 2007-10-22 12:50:18
Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.
Accounting Outsourcing and
Bookkeeping Outsourcing
tomfrederick
Posted 2007-10-30 07:55:35
Originally posted by shanehadson: I think that rohbots.txt is a file used to keep web pages from being
indexed by search engines. The Robots Exclusion page provides official details.
I think it is useful for u.
Accounting outsourcing and Bookkeeping Help
|
Thanks for this information. I m searching robot.txt last 2 to 3 month.
Christian debt consolidation And
Christian debt management
kenneth.robert
Posted 2007-12-27 09:47:36
Thanks for this information.
Secured personal loans And
Bad Debt Secured Loans
pankaj.sharma
Posted 2008-01-05 07:06:20
Robots.txt is a text file placed at the root on your site to guide search engines robots which pages you would like them not to visit.
GMI: Web application Development India and
GMI: Software Development India[Edited by pankaj.sharma on 2008-01-05 07:07:30]
stevewaganer
Posted 2008-01-23 06:45:49
robots.txt is a text file which is placed at root on your site for excluding the search engine robots from indexing all or part of your website. These are all reasons to block a search engine robot from indexing some pages, images, scripts and other elements of your website.
This file has some specific area needing some specific information.
user-agent and disallow
If you want to exclude all robots from indexing your website, you should add in robots.txt file
user-agent:*
disallow:/
terryson01
Posted 2008-01-29 08:14:53
Robots.txt is a text file.
All are saying right.
I am satisfied.
cash advance loans And
No fax payday cash advance loans
kavinpparker
Posted 2008-02-05 11:33:09
Robot.txt is nothing but a file written and stored in the root directory of a website that restricts the Search Engine spiders from indexing certain pages of the website. This file is used to disallow certain spiders from seeing files that you not want them to see. You can also prevent a certain spider to look at any of the web pages through this file.
netcreativemind
Posted 2008-06-09 14:15:01
ya they are the small program on your any webpage..and used to restrict your that page to get crawled by search engine spiders..
this is basically used to increase the privacy of your web page
http://seo.netcreativemind.com 
