feat: 404 log and report endpoint

- POST /_seo/api/v1/notfound with the golem15.seo.notfound_token bearer
  (constant-time, off when unset), URL and referer caps, a row cap with
  an hourly warning, throttle bucket seo-notfound
- golem15.seo.notfound list by hits with Resolved rows, a preview with the
  resolved hint, a prompted 301 and a 410 record action, a bulk 410 that
  refuses a selection with a covered address
- every /_seo/api/v1 answer carries X-Robots-Tag: noindex
This commit is contained in:
2026-10-27 11:35:25 +01:00
parent 163b0aaf98
commit 6eb6cb7a4d
18 changed files with 997 additions and 15 deletions

View File

@@ -10,3 +10,12 @@ site_url: ""
# prefix (for example pl on a site whose English pages start with /en).
# Empty leaves the choice to each content type.
unprefixed_locale: ""
#
# notfound_token is the shared secret the frontend server sends as
# "Authorization: Bearer <token>" with each 404 report to
# POST /_seo/api/v1/notfound. Empty turns the endpoint off (it answers 404).
notfound_token: ""
#
# notfound_max_rows caps the 404 log; new addresses beyond it are dropped,
# with one warning an hour.
notfound_max_rows: 10000