Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Streaming Cases #437

Closed
wants to merge 1 commit into from
Closed

Streaming Cases #437

wants to merge 1 commit into from

Conversation

alwayslove2013
Copy link
Collaborator

  • Modified the 'search_stage' based on the end of the insertion process rather than the start.
  • Errors occurring in the search sub-process will no longer interrupt the testing; they will only impact the metrics for that specific stage.
  • Only errors from the insert sub-process will halt the overall testing.
  • During concurrent search testing, database errors will not terminate the search test. QPS metrics will now only count successful requests.
  • Updated the front-end to allow customization of case_config via the UI.
  • Implemented a new page ('/streaming') to display results for streaming cases.

@sre-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: alwayslove2013
To complete the pull request process, please assign xuanyang-cn after the PR has been reviewed.
You can assign the PR to them by writing /assign @xuanyang-cn in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@alwayslove2013
Copy link
Collaborator Author

/hold

@alwayslove2013 alwayslove2013 force-pushed the streaming_case branch 2 times, most recently from 7cdaba4 to 300739b Compare January 9, 2025 04:09
@alwayslove2013
Streaming Cases
ac2bc8e 
- Modified the 'search_stage' based on the end of the insertion process rather than the start.
- Errors occurring in the search sub-process will no longer interrupt the testing; they will only impact the metrics for that specific stage.
- Only errors from the insert sub-process will halt the overall testing.
- During concurrent search testing, database errors will not terminate the search test. QPS metrics will now only count successful requests.
- Updated the front-end to allow customization of case_config via the UI.
- Implemented a new page ('/streaming') to display results for streaming cases.

Signed-off-by: min.tian <[email protected]>
XuanYang-cn
XuanYang-cn requested changes Jan 20, 2025
View reviewed changes
vectordb_bench/backend/cases.py Show resolved Hide resolved
vectordb_bench/backend/runner/mp_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/mp_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/mp_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/mp_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/mp_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/rate_runner.py Show resolved Hide resolved
vectordb_bench/backend/runner/serial_runner.py Show resolved Hide resolved
vectordb_bench/backend/task_runner.py Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@XuanYang-cn XuanYang-cn XuanYang-cn requested changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@alwayslove2013 @sre-ci-robot @XuanYang-cn