# Following are not searched/index by well behaved robots # Place in Root & any other directory as required # # NRB 08 Nov 2003 # NRB 30 Jan 2010 - add search files User-agent: * Disallow: /cgi-bin/ Disallow: /mailpage/ Disallow: /mailpage/mailme.html Disallow: /mailpage/mailme.htm Disallow: mailme.html Disallow: mailme.htm Disallow: search.php Disallow: worddatas.txt Disallow: worddatap.txt Disallow: *.php Disallow: *.txt