Package com.norconex.crawler.core.cluster.pipeline

Interface PipelineManager

All Known Implementing Classes:
HazelcastPipelineManager, LocalPipelineManager
public interface PipelineManager
Responsible for pipeline execution.

  • Method Details

    • executePipeline

      CompletableFuture<PipelineResult> executePipeline(Pipeline pipeline)
      Executes a pipeline.
      Parameters:
      pipeline - the pipeline to execute
      Returns:
      a future containing the pipeline execution result

    • stopPipeline

      CompletableFuture<Void> stopPipeline(String pipelineId)
      Stops a pipeline execution.
      Parameters:
      pipelineId - id of the pipeline to stop
      Returns:
      a future triggered when stopped

    • getPipelineProgress

      PipelineProgress getPipelineProgress(String pipelineId)
      A snapshot of pipeline progress made so far.
      Parameters:
      pipelineId - id of the pipeline to stop
      Returns:
      pipeline progress

    • stop

      void stop()
      Stops all pipeline executions.

    • addStepChangeListener

      void addStepChangeListener(CacheEntryChangeListener<StepRecord> listener)
      Adds a listener for step changes.
      Parameters:
      listener - the listener to add

    • removeStepChangeListener

      void removeStepChangeListener(CacheEntryChangeListener<StepRecord> listener)
      Removes a listener for step changes.
      Parameters:
      listener - the listener to remove

    • addWorkerStatusListener

      void addWorkerStatusListener(CacheEntryChangeListener<StepRecord> listener)
      Adds a listener for worker status changes.
      Parameters:
      listener - the listener to add

    • removeWorkerStatusListener

      void removeWorkerStatusListener(CacheEntryChangeListener<StepRecord> listener)
      Removes a listener for worker status changes.
      Parameters:
      listener - the listener to remove