WebshopBenchBot

WebshopBenchBot is a small research crawler operated by an independent UK developer. It gathers data for a public industry benchmark of engagement and retention mechanics on game direct-to-consumer web shops (for example: daily rewards, streaks, bundles, loyalty programs). Published findings are aggregated and anonymized.

What it does

It fetches a small number of publicly accessible pages per site — typically a storefront and one or two related public pages — at a low rate (at most one request every two seconds per domain), identifying itself with the user-agent string shown above. It respects robots.txt, including crawl-delay directives, and caches responses to avoid repeat fetches.

What it doesn't do

It does not create accounts, log in, submit forms, make purchases, bypass blocks or challenges, or collect personal data about individuals. If a site returns an error or blocks the bot, it is marked as off-limits and not retried.

Opting out

To exclude your site permanently, either block the user-agent WebshopBenchBot in your robots.txt, or email crawler@crawleye.online with your domain. Both are honored permanently, and on request we delete all stored data relating to your site.