Sweep: Fix the multi-processing error in vector_db by setting min 1 proces #3301
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This pull request introduces a fix for the multi-processing error encountered in the
vector_db
module of the SweepAI project. It ensures that at least one process is always used for operations that require multi-processing, addressing issues that arise when an intended number of processes is set to zero or a negative number.Summary
vector_db.py
under thesweepai/utils
directory.vector_db_operation
that takes an argumentintended_num_processes
to determine the number of processes to use.max
function.Pool
class from themultiprocessing
module to manage a pool of worker processes.some_other_module_needed_for_vector_db_operations
which is presumably required for the operations withinvector_db.py
.Fixes #3296.
🎉 Latest improvements to Sweep:
💡 To get Sweep to edit this pull request, you can: