Skip to content

Commit 25b74eb

Browse files
Add robots.txt
The site currently serves a 404 for /robots.txt (verified live). An explicit allow-all robots.txt is the baseline crawlers expect from a project site; files in public/ are copied into the export root, so this lands at documentdb.io/robots.txt. A Sitemap directive can be added once sitemap generation lands.
1 parent dd4e786 commit 25b74eb

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

‎public/robots.txt‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
User-agent: *
2+
Allow: /

0 commit comments

Comments
 (0)