User-agent: ia_archiver Disallow: / Crawl-delay: 20 Request-rate: 1/20 User-agent: * Disallow: /login Disallow: /browser Disallow: /log/*?* Disallow: /timeline/ Disallow: /roadmap/ Disallow: /report/ Disallow: /changeset/ Crawl-delay: 20 Request-rate: 1/20