PageWatch
The PageWatch bot
If you saw a visitor called ByMuhendisToolsPageWatch in your server logs, a PageWatch user is monitoring a page on your site.
What does it do?
It downloads a single page given by a user, at the interval the user chose (at most hourly), and looks for changes in its text. It does not follow links or crawl your site, it does not download images or scripts and it does not submit forms.
How to recognise it
Every request comes with this User-Agent: ByMuhendisToolsPageWatch/1.0 (+https://tools.bymuhendis.com/pagewatch/bot). We don't hide who we are or pretend to be a browser.
How to block it
Add "User-agent: ByMuhendisToolsPageWatch" followed by "Disallow: /" to your robots.txt. We read robots.txt once a day; the block takes effect within a day and monitors can no longer be set up for those pages.
Load
We wait at least a few seconds between two requests to the same site. If we get a 403 or 429 we count the check as failed and do not come back with retries. If you see a problem, contact us through bymuhendis.com.
User-agent: ByMuhendisToolsPageWatch Disallow: /