DFD-ScanBot
This page identifies the automated scanner that Dogfood Digital LLC uses to check public small-business websites, states how it behaves, and explains how a site owner can control it.
Agent identity
DFD-ScanBot is an automated scanning agent operated by Dogfood Digital LLC, a Florida limited liability company. It runs accessibility and general website-health checks against public small-business websites.
Current status
Public and third-party scanning is unhalted (HIS 2026-08-26: the halt was a Lighthouse-to-novel-toolset retool). Unhalting is permission, not execution; this page does not claim a public scan has run. There is no public, ongoing published schedule on this page. Owned-site scanning is separately authorized and is a different loop; this page does not run it and does not report whether that loop has started. Resumption of public scanning is an operator-controlled decision, not an automatic one. This page is transparency for DFD-ScanBot — it is not Retell (RC) voice I/O and not DFDC. This page has to exist and be reachable at this address, and the bot's outbound identification has to reference it accurately.
How this bot treats robots.txt
- Before requesting any page on a site, DFD-ScanBot fetches that site's
robots.txtfirst and evaluates it. - Disallow rules that apply to DFD-ScanBot — or to bots generally, where no bot-specific rule exists — are honored.
- A site with no
robots.txtfile (the server answers "not found") is treated per the web standard for robots files: absence permits crawling. A site whoserobots.txtis access-controlled is treated as declining bots. - If
robots.txtis unavailable — the server errors or cannot be reached — DFD-ScanBot defers: it does not scan on that attempt, and it does not attempt to route around the failure. - Every request identifies itself with a transparent, non-spoofed User-Agent that names this bot and links back to this page.
- Requests are throttled to polite rates; DFD-ScanBot does not scan aggressively or try to finish a scan by brute force of requests.
Owner controls — how to opt out
If you own or represent a site DFD-ScanBot has visited or may visit, you can stop it either way:
- Email onboard@dogfooddigital.com and ask us to stop, or
- Add a
Disallowrule forDFD-ScanBotto your site'srobots.txt.
Either one stops future scanning of that site. On opt-out, the scanning origin for that site is stopped, and any identified data already collected about it is flagged for deletion under our retention policy, below.
Data retention
Retention policy: identified artifacts follow the ruled 45–90 day FIFO window, with a 12-month capture ceiling; consented origins exempt; anonymous aggregate measurements are retained. The deleter is built and unarmed — deletion is an operator-controlled process, not automatic. The arm date at scan start is HIS.
Scope, honestly stated
DFD-ScanBot scans a safe, local small-business inventory. Regulated and sensitive verticals are excluded by policy. We do not scan the whole web, and we do not claim to scan "everyone" or "the whole market."
We do not publish rankings, percentile placements, or thresholds about any business, named or unnamed, and this page makes no claims about specific businesses. The scoring standard behind this work exists and is unpublished; a whitepaper draft and a versioned standard exist and are unpublished.
Contact
Dogfood Digital LLC
Email: onboard@dogfooddigital.com
Voice is planned as Retell (RC); the conversational brain behind it, DFDC, is hosted on a separate system and is not reachable from this site. Neither is available yet — email via onboard@dogfooddigital.com is the only contact route we offer.