Skip to content

3.0.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@hiworldwzj hiworldwzj released this 01 Nov 10:02
· 91 commits to main since this release
3.0.0
d9e3ba2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Version 3.0.0

Updates

  1. Support for CUDA Graph
  2. Improved Memory Management
  3. Startup Optimization
    • Use --mem_fraction
    • Automatically read eos_id and data_type information from config.json
  4. Refactor of Multimodal Code
Assets 2
Loading