Zakhar Bessarab 2c6fd59bed lib/httpserver: add handler to serve /robots.txt and deny search indexing (#4143) ...

This handler will instruct search engines that indexing is not allowed for the content exposed to the internet. This should help to address issues like #4128 when instances are exposed to the internet without authentication.

2023-05-08 09:53:33 -07:00

23 KiB

Raw Blame History

View Raw