# Robot exclusion file. For format see "A standard for robot exclusion" # at http://info.webcrawler.com/mak/projects/robots/norobots.html # # Simon Williams (webmaster@cf.ac.uk) 22nd August 2004 # # Don't distinguish between robots and block the lot - # we don't want the legacy site to be indexed. # User-agent: * Disallow: / User-agent: Ultraseek Disallow: