If a page loads for logged-in staff but not for anonymous visitors, it will not import. Treat missing URLs as a reachability problem before blaming the scan.
Sometimes the page imported under a different URL after redirects — search Knowledge for the final address, not only the old link.
Diagnose a missing page
- Open the URL in a private browser window — it must load without logging in
- Check robots.txt and page meta robots for disallow or noindex
- Follow redirects manually and note the final URL shown in the address bar
- Confirm the page is linked from navigation or listed in your sitemap
- Open Scan, read the error for that URL if listed, fix the site, then run another scan
Still missing after fixes
- Add a short FAQ or note in Knowledge with the facts from that page
- Verify you scanned the same domain where the page is published
- See Scan troubleshooting for firewall or intermittent fetch failures
Frequent causes
- PDF-only content with no HTML page to crawl
- Geo or bot blocking at the CDN edge
- New pages not yet linked anywhere — add an internal link, then rescan