# This robot.txt file should turn on ALL robots, crawlers and worms for visting
# ALL of your pages. The URL I extracted this from is at:
# 
#   http://info.webcrawler.com/mak/projects/robots/norobots.html
# 
# - joh 100197
# - amg 2/13/00
# - amg 3/23/00
# - amg 9/16/02 - added servlet
# - amg 10/21/03 - added includes and this note just to keep this note trail going, of course!
# - amg 04/26/06 - goodbye inkadinkydoo, our time together was far too short
#  wmd 10/20/08  complaint from google about find a high number of urls on our site, dissalow /ads/
#  wmd 10/21/08 don't crawl log files or customer files
User-agent: *
Disallow: /cgi-bin/
Disallow: /ads/
Disallow: /adtran/
Disallow: *.log
Disallow: /info/
Disallow: /info2/
Disallow: /includes/
Disallow: /hyperleads/
Disallow: /graphics/
Disallow: /temp/
Disallow: /test/
Disallow: /servlet/
Disallow: /community3/
Disallow: /community/view/*
Disallow: /ifind/*
Disallow: /java/*
Disallow: /javaforums/*
Disallow: /community/user/*