mirrors/gotosocial
1
0
Fork 0
mirror of https://github.com/superseriousbusiness/gotosocial.git synced 2025-12-24 19:56:20 -06:00
Code Issues Projects Releases Packages Wiki Activity Actions

[feature] Use ETag for robots.txt to prevent mishaps

Browse source
This commit is contained in:
tobi 2025-02-24 10:28:33 +01:00
commit 4e6874ac96
3 changed files with 10 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
internal/api/util/robots.go
View file

@ -130,4 +130,9 @@ Disallow: /.well-known/webfinger
Disallow: /.well-known/nodeinfo
Disallow: /nodeinfo/
`
// MD5 hash of basic robots.txt.
RobotsTxtETag = `ce6729aacbb16fae3628210c04b462b7`
// MD5 hash of robots.txt with NodeInfo disallowed.
RobotsTxtDisallowNodeInfoETag = `a1e4ce6342978bc8d6c3e3dfab07cab4`
)