#402 Add a robots.txt route.
Closed: Invalid 5 years ago by cverna. Opened 5 years ago by cverna.

While investigating greenwave's 502 response to bodhi, I found out that greenwave receives a lot of requests from goolgebot (~ 10,000 in 24h).

In order to stop that we need a robots.txt route that serves the static file.

I have originally opened an infra ticket but it looks like fixing this in our infra will be more difficult than having it done in the app itself.


I guess the content of this endpoint should be made configurable :)

I think we have a solution in the infra to solve this problem. So closing this

Metadata Update from @cverna:
- Issue close_status updated to: Invalid
- Issue status updated to: Closed (was: Open)

5 years ago

Login to comment on this ticket.

Metadata