Uses of Class
com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig
Packages that use WebDriverFetcherConfig
-
Uses of WebDriverFetcherConfig in com.norconex.crawler.web.fetch.impl.webdriver
Methods in com.norconex.crawler.web.fetch.impl.webdriver that return WebDriverFetcherConfigModifier and TypeMethodDescriptionWebDriverFetcher.getConfiguration()WebDriverFetcherConfig.setBrowser(WebDriverBrowser browser) The browser used for crawling.WebDriverFetcherConfig.setBrowserMaxAge(Duration browserMaxAge) A maximum duration at which we restart the browser.WebDriverFetcherConfig.setBrowserMaxNavigations(int browserMaxNavigations) A maximum number of navigations at which we restart the browser.WebDriverFetcherConfig.setBrowserPath(Path browserPath) Local path to browser executable ornullto attempt automatic browser path detection.WebDriverFetcherConfig.setCapabilities(Map<String, String> capabilities) Sets optional capabilities (configuration options) for the web driver.WebDriverFetcherConfig.setCleanupInterval(@NonNull Duration cleanupInterval) Amount of time between each check for unused browser instances and closing them.WebDriverFetcherConfig.setDriverPath(Path driverPath) Local path to driver executable ornullto attempt automatic detection of the driver path.WebDriverFetcherConfig.setEarlyPageScript(String earlyPageScript) Optional JavaScript code to be run the moment a page is requested.WebDriverFetcherConfig.setHttpSniffer(HttpSniffer httpSniffer) Optionally setup an HTTP proxy that allows to set and capture HTTP headers.WebDriverFetcherConfig.setImplicitlyWait(Duration implicitlyWait) Web driver max wait time for an element to appear.WebDriverFetcherConfig.setLatePageScript(String latePageScript) Optional JavaScript code to be run after we are done waiting for a page.WebDriverFetcherConfig.setPageLoadTimeout(Duration pageLoadTimeout) Web driver max wait time for a page to load.WebDriverFetcherConfig.setRemoteURL(URL remoteURL) URL of a remote WebDriver cluster.WebDriverFetcherConfig.setScreenshotHandler(WebDriverScreenshotHandler screenshotHandler) When configured, takes screenshots of each web pages.WebDriverFetcherConfig.setScriptTimeout(Duration scriptTimeout) Web driver max wait time for a scripts to execute.WebDriverFetcherConfig.setThreadWait(Duration threadWait) Makes the current thread sleep for the specified duration, to give the web driver enough time to load the page.WebDriverFetcherConfig.setUseHtmlUnit(boolean useHtmlUnit) Experimental feature where the selectedWebDriverBrowserwill be used to configure and use HtmlUnit WebDriver as a wrapper instead of directly using the browser WebDriver.WebDriverFetcherConfig.setWaitForElementSelector(String waitForElementSelector) Reference to an element to wait for.WebDriverFetcherConfig.setWaitForElementTimeout(Duration waitForElementTimeout) Max wait time for an element to show up in browser before returning.WebDriverFetcherConfig.setWaitForElementType(WebDriverFetcherConfig.WaitElementType waitForElementType) The type of reference to use when waiting for an element.WebDriverFetcherConfig.setWindowSize(Dimension windowSize) Optionally set the browser window dimensions.Methods in com.norconex.crawler.web.fetch.impl.webdriver with parameters of type WebDriverFetcherConfigModifier and TypeMethodDescriptionstatic org.openqa.selenium.WebDriverWebDriverFactory.create(WebDriverFetcherConfig config) Constructors in com.norconex.crawler.web.fetch.impl.webdriver with parameters of type WebDriverFetcherConfig