It worked

This page exists to be crawled. It's the whole reason minimum-config.xml works out of the box: point it here, run it, and a committed document confirms the pipeline ran end to end. maxDepth is 0, so nothing else gets pulled in — no other page changes what this example finds.

Pointing it at your own site​

Two edits turn this into a crawl of your own content instead. First, the start reference:

<startReferences>
  <ref>https://www.your-own-site.com/</ref>
</startReferences>

Then, once you're ready to crawl more than one page, keep it scoped to the part of the site you actually want:

<referenceFilters>
  <referenceFilter class="GenericReferenceFilter">
    <valueMatcher method="regex"
        pattern="https://www\.your-own-site\.com/only-this-section/.*"/>
  </referenceFilter>
</referenceFilters>

Next​

• Run the complex example to see variables, file inclusion, and conditional configuration sections in action.
• Read Quick Start: Web Crawler for the walkthrough this example is part of.
• Browse the configuration reference for every option the crawler supports.