Package com.norconex.crawler.web.doc.operations.delay.impl
package com.norconex.crawler.web.doc.operations.delay.impl
-
ClassDescriptionConvenience class to encapsulate various delay strategies.AbstractDelayResolver<T extends BaseDelayResolverConfig>Base implementation for creating voluntary delays between URL downloads.Base implementation for creating voluntary delays between URL downloads.It is assumed there will be one instance of this class per crawler defined.DelayRange<T>Default implementation for creating voluntary delays between URL downloads.Configuration for
GenericDelayResolver.Introduces different delays between document downloads based on matching document reference (URL) patterns.Configuration forReferenceDelayResolver.