Discover public website pages
The crawler follows reachable website navigation and page relationships to build a map of the public site structure used by the workflow.
WEBSITE CRAWLER
Website Crawler for Page and Asset Discovery
Discover the public structure of a website you are authorized to process, map reachable pages and gather the context required for capture or reconstruction workflows.
Identify required assets
Styles, scripts, images and other public resources can be identified so captured pages do not become disconnected from the files they require.
Support website reconstruction
Crawled structure can provide useful context when an authorized existing website needs to be reproduced or rebuilt into a new implementation.
Validate captured output
The broader REPLIXA workflow can check pages and assets after capture to surface missing resources and broken output.
Frequently asked questions
What does the REPLIXA website crawler do?
It discovers public pages and resources from websites you are authorized to process so their structure can be used in supported capture, cloning and reconstruction workflows.
Can a website crawler discover multiple pages?
Yes. Website crawling is intended to follow reachable public site structure rather than treating only the starting URL as the entire website.