Skip to content

Commit

Permalink
[nnpackage] Add mx dtypes to schema
Browse files Browse the repository at this point in the history
This adds mxfp4 and mxint8 to circle schema.

ONE-DCO-1.0-Signed-off-by: Hyukjin Jeong <[email protected]>
  • Loading branch information
jinevening committed Nov 5, 2024
1 parent 00dc8a9 commit 29f9e18
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions nnpackage/schema/circle_schema.fbs
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,11 @@ enum TensorType : byte {
GGML_Q4_1 = -3,
GGML_Q8_0 = -4,
GGML_Q8_1 = -5,


// MX dtypes
MXFP4 = -6,
MXINT8 = -7,
}

// Custom quantization parameters for experimenting with new quantization
Expand Down

0 comments on commit 29f9e18

Please sign in to comment.