Release v5.0.0
hiroshi-matsuda-rit
released this
25 Aug 03:24
·
199 commits
to master
since this release
ginza-5.0.0
- 2021-08-26, Demantoid
- Important changes
- Upgrade spaCy to v3
- Release transformer-based
ja-ginza-electra
model - Improve UPOS accuracy of the standard
ja-ginza
model by addingmorphologizer
to the tail of spaCy pipleline
- Release transformer-based
- Need to insrtall analysis model along with
ginza
package- High accuracy model (>=16GB memory needed)
pip install -U ginza ja-ginza-electra
- Speed oriented model
pip install -U ginza ja-ginza
- High accuracy model (>=16GB memory needed)
- Change component names of
CompoundSplitter
andBunsetuRecognizer
tocompound_splitter
andbunsetu_recognizer
respectively - Also see spaCy v3 Backwards Incompatibilities
- Upgrade spaCy to v3
- Improvements
- Add command line options
-n
- Force using SudachiPy's
normalized_form
asToken.lemma_
- Force using SudachiPy's
-m (ja_ginza|ja_ginza_electra)
- Select model package
- Revise ENE category name
Degital_Game
toDigital_Game
- Add command line options