Advanced

1. Success Status - The status to set when an item is successfully enriched.

2. Error Status - The status to set when an item fails enrichment.

3. The defaults should be fine for the following:

   • Initial Buffer Capacity - Controls the amount of work to queue at the start of the pipeline.

   • Update Maximum Degree of Parallelism - Maximum number of messages that can be processed by the pipeline concurrently.

   • Update Bounded Capacity - Maximum number of messages that can be queued for updating Elasticsearch.

   • Scroll Windows - How long to keep the scroll windows in memory for.

   • Scroll Size - Number of items to retrieve per request.

   • Queue Rate - Number of items to queue per-minute

     • 0 will leave the pipeline to calculate.

   • Rest Window - How long to wait before checking for new items to process.

4. If you are getting errors (perhaps you are using a step with an unreliable API), then consider using the following:

   • Enable Circuit Breaker - Stop the pipeline if errors occur.

   • File Exceptions Trigger Circuit Breaker - Stop the pipeline if file and indexing exceptions occur.