WebDriverBrowser

Supported browser types for WebDriver-based fetching.

crawler/webJavadoc: WebDriverBrowser

Notes

Selects the browser WebDriverFetcher drives through Selenium WebDriver, which also determines the driver it creates: CHROME, FIREFOX (the default), EDGE, SAFARI, OPERA, or CUSTOM for a browser you wire up yourself.

The browser and its matching driver have to exist somewhere the crawler can reach — installed locally, or on a remote WebDriver endpoint such as a Selenium Grid node or a browser container. Neither is bundled with the crawler. Use browserPath to point at a browser the crawler cannot find on its own, and driverPath for its driver.

Support for JavaScript-rendered pages is not exclusive to this fetcher. PlaywrightFetcher drives its own browsers through Playwright and takes a PlaywrightBrowser instead — a different engine and a different set of values, for the same purpose.

Examples

YAML

  fetchers:
    - class: WebDriverFetcher
      browser: CHROME

JSON

{
  "fetchers": [
    {
      "class": "WebDriverFetcher",
      "browser": "CHROME"
    }
  ]
}

XML

<fetchers>
  <fetcher class="WebDriverFetcher">
    <browser>CHROME</browser>
  </fetcher>
</fetchers>

Usage

Full configuration skeleton, with every option and its default

YAML

WebDriverBrowser: CHROME

JSON

{
  "WebDriverBrowser": "CHROME"
}

XML

<webDriverBrowser/>

Allowed Values

• CHROME
• FIREFOX
• EDGE
• SAFARI
• OPERA
• CUSTOM