You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
However, I am unable to load the model and encountered the following error:
Traceback (most recent call last):
File "/data1/hya/private/old_book/second/GetHardBookPairs.py", line 39, in <module>
reranker = FlagLLMReranker('/data1/hya/private/old_book/second/checkpoint-140',cache_dir='/data1/hya/cache')
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/FlagEmbedding/inference/reranker/decoder_only/base.py", line 180, in __init__
self.model = AutoModelForCausalLM.from_pretrained(
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained
return model_class.from_pretrained(
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4041, in from_pretrained
model.load_adapter(
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/transformers/integrations/peft.py", line 188, in load_adapter
peft_config = PeftConfig.from_pretrained(
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/peft/config.py", line 152, in from_pretrained
return cls.from_peft_type(**kwargs)
File "/data1/hya/miniconda3/envs/LLM/lib/python3.10/site-packages/peft/config.py", line 119, in from_peft_type
return config_cls(**kwargs)
TypeError: LoraConfig.__init__() got an unexpected keyword argument 'eva_config'
The text was updated successfully, but these errors were encountered:
I followed the code below to fine-tune the model:
After obtaining a
checkpoint
folder, I tried loading the model with the following code:However, I am unable to load the model and encountered the following error:
The text was updated successfully, but these errors were encountered: