User-agent: * Crawl-delay: 10 Request-rate: 1/10 # maximum rate is one page every 10 seconds Visit-time: 1400-1100 # only visit between 09:00 and 6:00 UTC (GMT) Disallow: /ad Disallow: /archive Disallow: /classifieds Disallow: /forum Disallow: /newsletter Disallow: /images Disallow: /photos Disallow: /printads Disallow: /search Disallow: /user Disallow: /weather Disallow: /wire Disallow: /wire.lasso Disallow: /copydesk Disallow: /ike Disallow: /mod_weather Disallow: /templates Disallow: /stories Disallow: /proofs