9:855a89f33e5e default tip
Anton Shestakov <av6@dwimlabs.net>, Mon, 28 Sep 2020 21:30:03 +0800
hgweb: run on Python 3

previous change 1:cb5e027c0015

roles/hgweb/files/robots.txt

Permissions: -rw-r--r--

Other formats: Feeds:
User-agent: *
# Expensive pages
Disallow: /*/annotate/
Disallow: /*/comparison/
Disallow: /*/diff/
Disallow: /*/archive/
# File log is too much
Disallow: /*/log/*/
# API is off-limits
Disallow: /*/json-*
Disallow: /*/raw-*
# Paginate instead
Disallow: /*?revcount=
# Graph page is a more expensive log
Disallow: /*/graph$
Disallow: /*/graph/
# It's for humans
Disallow: /*/help$
Disallow: /*/help/