Commit graph

2 commits

Author SHA1 Message Date
tobi
5fa33bcad5 use switch for RobotsHeaders 2025-02-05 12:19:39 +01:00
tobi
419294704e [feature] Use X-Robots-Tag headers to instruct scrapers/crawlers 2025-02-05 12:16:31 +01:00