# ROBOTS.TXT file created by Accrisoft Freedom # Created on Mon Nov 22 4:39:40 GMT 2004 for site www.kiamagolfclub.com.au # Any lines in this file starting with a \\\"#\\\" character # is considered a comment and will not be processed by # a robot. # Section 1 # The following directive allows all robots to crawl your # site. To allow specific robots to crawl your site, # comment the following two lines and uncomment # the lines of the robots listed in Section 2, or add your own. User Agent: * Disallow: # To disallow all robots from crawling your site, uncomment # the following two lines. #User Agent: * #Disallow: / # Section 2 # By uncommenting the \\\"User Agent\\\" and \\\"Disallow\\\" lines for the # following robots, you are allowing the robot to crawl your # site. Leaving the \\\"Disallow\\\" entry blank will allow the robot # to crawl the entire site. You may restrict access to a directory # or file by specifying it in the Disallow line (to restrict multiple # files/directories, add additional \\\"Disallow\\\" lines). # # The following example allows Google to crawl your site except # for the example.html file and the /cgi-bin directory. # # # Google # User Agent: Googlebot # Disallow: example.html # Disallow: /cgi-bin/ # Google User Agent: Googlebot Disallow: Yahoo User Agent: Slurp Disallow: # Alta-Vista #User Agent: Scooter #Disallow: # Excite #User Agent: ArchitextSpider #Disallow: InfoSeek User Agent: UltraSeek Disallow: Lycos User Agent: Lycos_Spider_(T-Rex) Disallow: LookSmart User Agent: MantraAgent Disallow: Alltheweb User Agent: FAST-WebCrawler Disallow: