User-agent: wget Allow: /mosaic_archive Disallow: / User-agent: Nutch Disallow: / User-agent: * Disallow: /