Skip to content

Scan troubleshooting

Fix failed or thin scans when the crawler cannot reach pages or hits robots blocks.

A scan fails or looks empty when Amevia cannot fetch your public pages — not when the agent is misconfigured. Start with reachability, then robots rules, then per-URL errors.

Troubleshoot scans

  1. Open the connected domain in a private window — homepage must load without VPN-only access
  2. Finish website verification or install steps if Overview still shows them pending
  3. Fetch /robots.txt and confirm you are not disallowing the paths you need
  4. Open Scan and read errors for failed URLs — note 403, 404, timeout or redirect loops
  5. Fix the live site, then start a new scan from Scan or Overview

After partial success

  1. Publish successful imports in Knowledge even if some URLs failed
  2. Add manual FAQs for pages that cannot be crawled
  3. See Pages missing from a scan for one-off URL diagnosis

Infrastructure blockers

  • Bot fight modes at the CDN may throttle crawlers — allowlist or relax for scan windows
  • Very slow TTFB can timeout fetches — improve host response first
  • Scan the correct website connection if you operate multiple domains
Scan troubleshooting — Amevia Help