---
title: "How does Lemwatch track robots.txt changes? — Lemwatch Help"
description: "Lemwatch snapshots robots.txt on every check and alerts when disallow rules change, sitemaps disappear, or the file returns non-200."
canonical: "https://lemwatch.com/help/robots-txt-monitoring"
source: "https://lemwatch.com"
---

# How does Lemwatch track robots.txt changes?

> Lemwatch snapshots robots.txt on every check and alerts when disallow rules change, sitemaps disappear, or the file returns non-200.

## Quick answer

 We snapshot /robots.txt on every scheduled check, diff against the last version, and alert when disallow rules change, sitemap declarations disappear, or the file returns anything other than 200 OK.

## What we flag

- Disallow: / (catastrophic — blocks all crawlers)

- New Disallow: rules on important paths

- Removed Sitemap: declarations

- Non-200 responses on the robots file

## Where to find it in Lemwatch

 **Site → SEO → Robots.txt** — see current file plus a change log.

## FAQ

### Do you check per user-agent?

 Yes — Googlebot, Bingbot, and generic (*) blocks are tracked separately.

## Related

- Sitemap monitoring

- SEO monitoring overview


## Related

- [Help centre](https://lemwatch.com/help)
- [How does Lemwatch monitor XML sitemaps?](https://lemwatch.com/help/sitemap-monitoring)
- [SEO Health Monitoring](https://lemwatch.com/help/seo-monitoring)
- [How does Lemwatch track Google indexation?](https://lemwatch.com/help/indexation-tracking)
- [How does Lemwatch validate canonical URLs?](https://lemwatch.com/help/canonical-url-checks)
- [How does Lemwatch check hreflang tags?](https://lemwatch.com/help/hreflang-monitoring)
- [Lemwatch pricing](https://lemwatch.com/pricing)
- [Rocket.Chat Integration](https://lemwatch.com/help/rocketchat-integration)