Zakhar Bessarab 79ee1749a1 lib/httpserver: add handler to serve /robots.txt and deny search indexing (#4143) ...

This handler will instruct search engines that indexing is not allowed for the content exposed to the internet. This should help to address issues like #4128 when instances are exposed to the internet without authentication.

2023-05-08 09:46:34 -07:00

..

httpserver.go

lib/httpserver: add handler to serve /robots.txt and deny search indexing (#4143)

2023-05-08 09:46:34 -07:00

path.go

lib/httpserver: link to url format docs in error message emitted on parse error for the provided url path

2022-11-28 18:49:03 -08:00