website/build/robots.txt.production

mirror of https://github.com/offen/website.git synced 2024-10-18 12:10:25 +02:00
User-agent: *
Disallow: /legal-privacy/

Sitemap: https://www.offen.dev/sitemap.xml
add robots.txt files for staging and production envs 2019-09-29 16:08:41 +02:00			`User-agent: *`
remove obsolete paths from robots.txt 2021-04-08 19:26:36 +02:00			`Disallow: /legal-privacy/`
clean up index related code 2019-12-27 23:09:42 +01:00
use fqdn for sitemap in robots file 2020-07-09 13:37:54 +02:00			`Sitemap: https://www.offen.dev/sitemap.xml`