Skip to content

Commit

Permalink
doc: add example and explanation for retryInterval in pipeline tuning…
Browse files Browse the repository at this point in the history
… page

Signed-off-by: Quentin Faidide <[email protected]>
  • Loading branch information
QuentinFAIDIDE committed Apr 8, 2024
1 parent e1a11d2 commit 29bb098
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions docs/user-guide/reference/pipeline-tuning.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ processing cycle.
- `readBatchSize` - How many messages to read for each cycle, defaults to `500`.
- `bufferMaxLength` - How many unprocessed messages can be existing in the Inter-Step Buffer, defaults to `30000`.
- `bufferUsageLimit` - The percentage of the buffer usage limit, a valid number should be less than 100. Default value is `80`, which means `80%`.
- `retryInterval` - The time to wait before retrying after a failure of the UDF or of the ISBSVC.

These parameters can be customized under `spec.limits` as below, once defined, they apply to all the vertices and Inter-Step Buffers of the pipeline.

Expand All @@ -20,6 +21,7 @@ spec:
readBatchSize: 100
bufferMaxLength: 30000
bufferUsageLimit: 85
retryInterval: 0.05s
```
They also can be defined in a vertex level, which will override the pipeline level settings.
Expand All @@ -34,6 +36,7 @@ spec:
readBatchSize: 100
bufferMaxLength: 30000
bufferUsageLimit: 85
retryInterval: 0.05s
vertices:
- name: in
source:
Expand Down

0 comments on commit 29bb098

Please sign in to comment.