Package com.norconex.crawler.web.fetch.util
package com.norconex.crawler.web.fetch.util
-
ClassDescriptionBase class for screenshot handlers that capture browser page images during crawling.Utility methods for fetcher implementations using Apache HttpClient.This class is used by each crawler instance to capture the closest redirect target whether it is part of a redirect chain or not.Handles images associated with a document (which is different than a document being itself an image).Configuration for
DocImageHandler.Directory structure when storing images on disk.Provide redirect URLs by grabbing them from the HTTP ResponseLocationheader value.Configuration forGenericRedirectUrlProvider.Class handling HSTS support for servers supporting it.Responsible for providing a target absolute URL each time an HTTP redirect is encountered when invoking a URL.Configuration for screenshot handlers (Selenium WebDriver and Playwright).A very unsafe trust manager accepting ALL certificates.