31:65daf0ee01ec
Anton Shestakov <av6@dwimlabs.net>, Sun, 27 Sep 2020 18:59:01 +0800
gunicorn: add .py extension to the config file name
previous change 30:0e84a4a22acd

roles/hgweb/files/robots.txt

Permissions: -rw-r--r--

File Latest Revisions Annotate Diff Comparison
Other formats:
JSON Raw
Feeds:
Atom RSS 
User-agent: *
# Expensive pages
Disallow: /*/annotate/
Disallow: /*/comparison/
Disallow: /*/diff/
Disallow: /*/archive/
# File log is too much
Disallow: /*/log/*/
# API is off-limits
Disallow: /*/json-*
Disallow: /*/raw-*
# Paginate instead
Disallow: /*?revcount=
# Graph page is a more expensive log
Disallow: /*/graph$
Disallow: /*/graph/
# It's for humans
Disallow: /*/help$
Disallow: /*/help/