Merge pull request Aspen-Discovery#1778 from lizrea/patch-3

Add GPTBot to robots.txt
PTFS-Europe · Apr 24, 2024 · 4dc8936 · 4dc8936
2 parents 67b88d1 + 4bc82a1
commit 4dc8936
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/code/web/robots.txt b/code/web/robots.txt
@@ -80,6 +80,9 @@ Disallow: /
 User-Agent: MJ12bot
 Disallow: /
 
+User-Agent: GPTBot
+Disallow: /
+
 User-agent: 360Spider
 Disallow: /