About the Help Center Check crawler

XyntheriumAnswerWatch/0.1 (+https://www.xyntherium.com/help-center-check/bot) fetches public pages that a Help Center Check customer asked us to watch, usually their own return policy, pricing or terms. It fetches each page about once a day, and again when the customer presses “check now”.

  • It reads robots.txt before every page. A group for XyntheriumAnswerWatch wins over *, and a disallowed page is never fetched.
  • It does not follow links, run JavaScript, submit forms or log in.
  • It sends conditional requests (ETag and Last-Modified) so an unchanged page costs almost nothing.

To stop it, add User-agent: XyntheriumAnswerWatch and Disallow: / to your robots.txt, or write to support@xyntherium.com.