Sweep: Fix the multi-processing error in sweepai/core/vector_db.py by setting min 1 process

[sweep-nightly]

Description

This pull request addresses an issue in the sweepai/core/vector_db.py where the number of processes for the multiprocessing pool could be set to zero on machines with a low number of CPU cores. The fix ensures that there is always at least one process available for the pool, preventing potential errors during the embedding of text arrays.

Summary

• Fixed a potential division by zero error in sweepai/core/vector_db.py by ensuring the multiprocessing pool is always initialized with at least one process.
• Modified the calculation of the number of processes for the multiprocessing.Pool to max(1, multiprocessing.cpu_count() // 4), guaranteeing a minimum of one process.
• This change affects the embed_text_array function within the vector_db.py file, improving its reliability on systems with fewer CPU cores.

Fixes #3296.

---

🎉 Latest improvements to Sweep:

• New dashboard launched for real-time tracking of Sweep issues, covering all stages from search to coding.
• Integration of OpenAI's latest Assistant API for more efficient and reliable code planning and editing, improving speed by 3x.
• Use the GitHub issues extension for creating Sweep issues directly from your editor.

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

[sweep-nightly]

Rollback Files For Sweep

• Rollback changes to sweepai/core/vector_db.py

This is an automated message generated by Sweep AI.

[sweep-nightly]

Apply Sweep Rules to your PR?

• Apply: We should use loguru for error logging. If the log is inside an exception, use logger.exception to add tracebacks, where logger is imported from loguru. Use f-strings for string formatting in logger calls (e.g. logger.info(f'Hello {name}') instead of logger.info('Hello {name}', name=name)).
• Apply: There should be no debug log or print statements in production code.
• Apply: All functions should have parameters and output annotated with type hints. Use list, tuple and dict instead of typing.List, typing.Tuple and typing.dict.
• Apply: Leftover TODOs in the code should be handled.
• Apply: All new business logic should have corresponding unit tests in the same directory. For example, sweepai/api_test.py tests sweepai/api.py. Use unittest and unittest.mock as required.
• Apply: Any clearly inefficient or repeated code should be optimized or refactored.
• Apply: Remove any comments before code that are obvious. For example # this prints hello world; print('hello world').

This is an automated message generated by Sweep AI.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
sweep-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Mar 15, 2024 2:11am