4 commits

Author	SHA1	Message	Date
Oliver Davies	e45f86dd4e	Add sitemaps to robots.txt	2021-03-05 19:58:40 +00:00
Oliver Davies	51c4bc2f85	Update robots.txt paths	2021-03-05 19:50:52 +00:00
Oliver Davies	f082981d5f	Add more disallowed URLs	2021-01-15 12:48:26 +00:00
Oliver Davies	469be1f621	Append removed URLs to robots.txt	2021-01-15 09:13:26 +00:00