updated robots.txt Non latest documentation fixes#1960 (#1154)

* updated robots.txt * Update docs/robots.txt * Update docs/robots.txt --------- Co-authored-by: Jean-Robin <[email protected]>
Avaiga · Oct 30, 2024 · 89fc021 · 89fc021
1 parent 6b8c408
commit 89fc021
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/docs/robots.txt b/docs/robots.txt
@@ -1,5 +1,5 @@
 User-agent: *
 Allow: /en/latest/ # Allow all robots to access the latest version of the documentation
-Disallow: /en/ # Disallow all robots to access the other versions of the documentation
+Disallow: /en/release-*/ # Disallow all other versions except 'latest'
 
 Sitemap: https://docs.taipy.io/sitemap.xml