Norconex Crawler v4 is feature-complete and ready for a beta release. It is a rewrite, not a patch on v3 — new configuration model, new connector lineup, a free visual configurator, and documentation generated straight from the schema instead of hand-maintained alongside it. We think it holds up. Now we want a lot of configurations we did not write pointed at it, so tell us where it doesn't.

Version 4 changed enough of this crawler that the mascot on the front of it no longer described the thing behind it. So we drew a new one. Meet Nexie.