Enhance Speculative Generation with Better Type Hints and Cleaner Code#611

Open

mandlinsarah wants to merge 1 commit intobigscience-workshop:mainfrom mandlinsarah:update-speculative_model-08-30-2024

+8-7

Commits on Aug 30, 2024

Improve speculative generation by adding type hints for streamers and minor refactor
mandlinsarah
committed