diff options
| author | Daniel Baumann <daniel.baumann@progress-linux.org> | 2023-01-24 12:33:51 +0000 |
|---|---|---|
| committer | Daniel Baumann <daniel.baumann@progress-linux.org> | 2023-01-24 12:33:51 +0000 |
| commit | 3ea39841c8049525e31e9f4d6300f0c60cdb42de (patch) | |
| tree | 855de60a8872eafb5911acd303aedcdbfe713a73 /site/layouts/robots.txt | |
| parent | Inital commit. (diff) | |
| download | bootstrap-html-3ea39841c8049525e31e9f4d6300f0c60cdb42de.tar.xz bootstrap-html-3ea39841c8049525e31e9f4d6300f0c60cdb42de.zip | |
Adding upstream version 5.2.3+dfsg.upstream/5.2.3+dfsg
Signed-off-by: Daniel Baumann <daniel.baumann@progress-linux.org>
Diffstat (limited to 'site/layouts/robots.txt')
| -rw-r--r-- | site/layouts/robots.txt | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/site/layouts/robots.txt b/site/layouts/robots.txt new file mode 100644 index 0000000..271b4f1 --- /dev/null +++ b/site/layouts/robots.txt @@ -0,0 +1,12 @@ +# www.robotstxt.org + +{{- $isProduction := eq hugo.Environment "production" -}} +{{- $isNetlify := eq (getenv "NETLIFY") "true" -}} +{{- $allowCrawling := and (not $isNetlify) $isProduction -}} + +{{ if $allowCrawling }} +# Allow crawling of all content +{{- end }} +User-agent: * +Disallow:{{ if not $allowCrawling }} /{{ end }} +Sitemap: {{ "/sitemap.xml" | absURL }} |