Repository navigation
Commit 25b74eb
committed
Add robots.txt
The site currently serves a 404 for /robots.txt (verified live). An
explicit allow-all robots.txt is the baseline crawlers expect from a
project site; files in public/ are copied into the export root, so this
lands at documentdb.io/robots.txt. A Sitemap directive can be added once
sitemap generation lands.1 parent dd4e786 commit 25b74eb
1 file changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
0 commit comments