WorthToTryBot

How to recognise it

WorthToTryBot/1.0 (+https://worthtotry.com/bot)

Anything claiming to be us without that string is not us, and we cannot do anything about it. We do not run the crawler from a residential proxy pool and we do not rotate the name.

What it asks for, and how often

• A listing you submitted

  Once, while you are filling the form in

  Reads the page to prefill the listing and take one screenshot, so you are not typing what your own site already says.

• A listed product’s site

  Up to 120 a night, each one no more often than every 8 days

  Checks whether the listing still links back, and records whether the site answered at all.

• A directory on our public list

  A sweep at the same pace, a day apart at the very least

  Confirms the submission page still resolves, so we do not send founders at dead links.

It reads pages. It does not submit forms, follow links beyond the one page it was pointed at, or try to reach anything behind a login.

How to stop it

It reads robots.txt before every fetch and obeys it, including Crawl-delay. To turn it away entirely:

User-agent: WorthToTryBot
Disallow: /

That is enough — you do not need to write to us as well, and blocking us does not remove or penalise a listing. It only means we can no longer check whether your site links back, so the verified mark will not appear on it.

Anything else

To have a listing corrected or removed, or to report the crawler behaving badly, write to hello@worthtotry.com. A misbehaving crawler is a bug and we would rather hear about it than not. More on how listings work is on the contact page.