User-agent: * Disallow: /java/ Disallow: /sun/DOC4.0 Disallow: /pub/doc/sun/DOC4.0 Disallow: /sun/DOC5.0 Disallow: /pub/doc/sun/DOC5.0 Disallow: /pub/linux Disallow: /pub/bsd Disallow: /pub/tex-archive Disallow: /pub/public_patches/ Disallow: /camonly/ User-agent: Ultraseek (webmaster@ucs.cam.ac.uk) User-agent: Ultraseek (internal search; webmaster@ucs.cam.ac.uk) # Be much more restrictive to save on bad search results Disallow: /pub/ Disallow: /camonly/ Disallow: /java/ #Disallow: /java/tutorial #Disallow: /sun/DOC4.0 #Disallow: /pub/doc/sun/DOC4.0 #Disallow: /sun/DOC5.0 #Disallow: /pub/doc/sun/DOC5.0 ## Don't serve mirrored documents through Cambridge search engines. #Disallow: /netdoc #Disallow: /pub/doc/faq #Disallow: /pub/doc/internet-drafts #Disallow: /pub/doc/cert #Disallow: /pub/doc/rfc #Disallow: /pub/linux #Disallow: /pub/bsd #Disallow: /pub/gnu #Disallow: /java #Disallow: /pub/tex-archive #Disallow: /pub/public_patches/DEC/OLD