Skip to main content

Downloads

Get the crawler

Every release ships as a self-contained ZIP and as an official Docker image, for both the web and file system crawlers. Pick a version, take a package, and you are crawling in minutes.

  • Java 21+Only prerequisite
  • ZIP or DockerTwo ways to run it
  • Apache 2.0Free and open source
Checking GitHub for the latest release…Looking for version 3.x or earlier? Visit opensource.norconex.com.

Ready-to-run packages

PackageWeb CrawlerFile System Crawler
ZIP · StandardEverything a typical crawl needs, and the smaller download. Start here.
ZIP · FullStandard plus every optional extra, listed below.
Docker imageMatches the Full ZIP, with all committers already installed.
Docker · PlaywrightAdds the Playwright engine with Chromium preinstalled. WebDriver rendering ships in every package, but expects a browser you supply.
What does Full add?

Web Crawler

  • Clustering (multi-node crawling)
  • Advanced XML parsing and validation
  • Extra image formats (JPEG 2000, WebP)
  • Advanced parsing: OCR, NLP, language detection, translation, scientific/media/SQLite formats
  • JavaScript-based configuration scripting
  • Microsoft Office document parsing (Word, Excel, PowerPoint, ...)

File System Crawler

  • Clustering (multi-node crawling)
  • Advanced parsing: OCR, NLP, language detection, translation, scientific/media/SQLite formats
  • JavaScript-based configuration scripting

Committer add-ons​

9 optional committers ship as ZIPs alongside every release — the rest are built in. Copy the JARs into your crawler's lib folder; Installation has the commands. Not sure which one you need? Compare them all on Integrations.

After you download

  • Install it

    Unpack, check your Java version, and add committer JARs to lib/.

  • Run it in Docker

    Tags, volume mounts, and Compose examples for both crawlers.

  • Crawl something

    A first configuration, from a starting URL to indexed content.