gotosocial/internal/middleware
kim d8c4d9fc5a [feature] proof of work scraper deterrence (#4043)
This adds a proof-of-work based scraper deterrence to GoToSocial's middleware stack on profile and status web pages. Heavily inspired by https://github.com/TecharoHQ/anubis, but massively stripped back for our own usecase.

Todo:
- ~~add configuration option so this is disabled by default~~
- ~~fix whatever weirdness is preventing this working with CSP (even in debug)~~
- ~~use our standard templating mechanism going through apiutil helper func~~
- ~~probably some absurdly small performance improvements to be made in pooling re-used hex encode / hash encode buffers~~ the web endpoints aren't as hot a path as API / ActivityPub, will leave as-is for now as it is already very minimal and well optimized
- ~~verify the cryptographic assumptions re: using a portion of token as challenge data~~ this isn't a serious application of cryptography, if it turns out to be a problem we'll fix it, but it definitely should not be easily possible to guess a SHA256 hash from the first 1/4 of it even if mathematically it might make it a bit easier
- ~~theme / make look nice??~~
- ~~add a spinner~~
- ~~add entry in example configuration~~
- ~~add documentation~~

Verification page originally based on https://github.com/LucienV1/powtect

Co-authored-by: tobi <tobi.smethurst@protonmail.com>
Reviewed-on: https://codeberg.org/superseriousbusiness/gotosocial/pulls/4043
Reviewed-by: tobi <tsmethurst@noreply.codeberg.org>
Co-authored-by: kim <grufwub@gmail.com>
Co-committed-by: kim <grufwub@gmail.com>
2025-04-28 20:12:27 +00:00
..
cachecontrol.go [bugfix] Set Vary header correctly on cache-control (#1988) 2023-07-13 21:27:25 +02:00
contentsecuritypolicy.go [feature] Set some security related headers (#3065) 2024-07-04 10:07:02 +02:00
contentsecuritypolicy_test.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
cors.go [chore] Rewrite all remaining Github links 2025-04-27 13:40:22 +02:00
extraheaders.go [feature] Use X-Robots-Tag headers to instruct scrapers/crawlers (#3737) 2025-02-05 12:47:13 +01:00
gzip.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
headerfilter.go [feature] proof of work scraper deterrence (#4043) 2025-04-28 20:12:27 +00:00
headerfilter_test.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
logger.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
nollamas.go [feature] proof of work scraper deterrence (#4043) 2025-04-28 20:12:27 +00:00
nollamas_test.go [feature] proof of work scraper deterrence (#4043) 2025-04-28 20:12:27 +00:00
ratelimit.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
ratelimit_test.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
requestid.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
robots.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
session.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
session_test.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
signaturecheck.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
throttling.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
throttling_test.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
tokencheck.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
useragent.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00
util.go [feature] Move to code.superseriousbusiness.org 2025-04-26 15:38:43 +02:00