View Single Post
Old 08-06-2007   #6
god
Registered Member
 
god's Avatar
 
Last Online: 02-14-2010
Join Date: Mar 2006
Posts: 846
Thanks: 71
Thanked 293 Times in 217 Posts
Groans: 0
Groaned at 0 Times in 0 Posts
Default Re: The robots.txt file!

Quote:
Originally Posted by systamatics View Post
so wats the use of the robot.exe , we wont have access to the files , i dont get it
in reply to that:
Quote:
Originally Posted by god View Post
Now how you can actually use this info ? it depends it can be quite useful, and sometimes meaningless!
Figure that out on yourself :P as i said it depends, if you're trying to find something in a website, this file might give u a better understanding of the structure of the site, and maybe tell you what CMS the website is using... look i cant tell u what to do letter by letter that would be illegal :P + i wont do it hehe
__________________
--Capitalisation is the only difference between "I helped my uncle Jack off a horse" and "I helped my uncle jack off a horse" !!
http://img482.imageshack.us/img482/4889/hell7ta.jpg
god is offline   Reply With Quote