Package com.norconex.crawler.web
Class WebCrawler
java.lang.Object
com.norconex.crawler.web.WebCrawler
Facade for launching or obtaining a Web Crawler.
-
Method Summary
-
Method Details
-
main
Invokes the Web Crawler from the command line. You can invoke it without any arguments to get a list of command-line options.- Parameters:
args- command-line options
-
launch
Launches the Web Crawler. Similar tomain(String[]), but do not callSystem.exit(int)and returns the execution status code instead. It will throw a runtime exception upon failure (typically aCrawlerException).- Parameters:
args- command line arguments- Returns:
- execution status code
-
create
Creates a Web Crawler instance.- Parameters:
crawlerConfig- Web Crawler configuration- Returns:
- crawler
-