Enhanced Quantizer with QINT16 Support #2874
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
djeong20
requested review from
myungjoo,
jijoongmoon,
again4you,
jaeyun-jung,
leemgs,
wooksong,
gichan-jang,
anyj0527,
lhs8928,
songgot,
jihochu,
DonghakPark,
SeoHyungjun,
baek2sm,
skykongkong8 and
EunjuYang
as code owners
djeong20
force-pushed
the
update/quantizer/v2
branch
2 times, most recently
from
ce54643 to
bc3f6af
Compare
djeong20
changed the title
djeong20
force-pushed
the
update/quantizer/v2
branch
from
bc3f6af to
368a72b
Compare
djeong20
changed the title
skykongkong8
approved these changes
Jan 20, 2025
This PR enhances the quantizer by leveraging the output tensor along with scale factors for more accurate quantization. Furthermore, it introduces support for the QINT16 data type, expanding our capabilities and improving performance. **Self-evaluation:** 1. Build test: [X]Passed [ ]Failed [ ]Skipped 2. Run test: [X]Passed [ ]Failed [ ]Skipped Signed-off-by: Donghyeon Jeong <[email protected]>
djeong20
force-pushed
the
update/quantizer/v2
branch
from
368a72b to
1dc0047
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR enhances the quantizer by leveraging the output tensor along with scale factors for more accurate quantization.
Furthermore, it introduces support for the QINT16 data type, expanding our capabilities and improving performance.
Self-evaluation: