mirrors/gotosocial
1
0
Fork 0
mirror of https://github.com/superseriousbusiness/gotosocial.git synced 2025-12-23 16:56:15 -06:00
Code Issues Projects Releases Packages Wiki Activity Actions
2,305 commits 13 branches 97 tags 518 MiB
Commit graph

2 commits

Author SHA1 Message Date
tobi
4e6874ac96 [feature] Use ETag for robots.txt to prevent mishaps 2025-02-24 10:28:33 +01:00
tobi
baed591a1d
 		[feature] Use X-Robots-Tag headers to instruct scrapers/crawlers (#3737) 
* [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers

* use switch for RobotsHeaders
 2025-02-05 12:47:13 +01:00