about inference error

[cwt000297]

Exception: data did not match any variant of untagged enum ModelWrapper at line 646517 column 3

[HubHop]

Hi @cwt000297, I might be able to help further if you can provide more context.

[liu-97max]

@HubHop hi 我将deepseek-vl2做了lora微调后推理，遇到了相同的报错：
File "/opt/conda/envs/swift38/lib/python3.8/site-packages/transformers/tokenization_utils_fast.py", line 111, in init
fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
Exception: data did not match any variant of untagged enum ModelWrapper at line 646517 column 3

[liu-97max]

@HubHop你好，我将deepseek-vl2做了lora感知后推理，遇到了相同的报错：File "/opt/conda/envs/swift38/lib/python3.8/site-packages/transformers/tokenization_utils_fast.py", line 111, in init fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file) Exception: data did not match anyvariant of untagged enum ModelWrapper 位于第 646517 行第 3 列

微调：torch: 2.5.1+cu121， transformers: 4.47.1， xformers: 0.0.28.post3，timm: 1.0.14
推理：torch==2.0.1，transformers==4.38.2，xformers：0.0.22，timm: 1.0.14

[liu-97max]

@HubHophi好，我将deepseek-vl2做了lora感知后推理，遇到了相同的报错：File "/opt/conda/envs/swift38/lib/python3.8/site-packages/transformers/tokenization_utils_fast.py", line 111, in init fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file) Exception: data did not match未标记枚举 ModelWrapper的任何变体位于第 646517 行第 3 列

扭矩：torch: 2.5.1+cu121，transformers: 4.47.1， xformers: 0.0.28.post3，timm: 1.0.14 推理：torch==2.0.1，transformers==4.38.2，xformers：0.0.22，timm: 1.0.14

已解决，transformers==4.41.1