[Finetune] use base model mpt-7b instead of mpt-7b-chat (#181)

* use base model mpt-7b instead of mpt-7b-chat Signed-off-by: minmingzhu <[email protected]> * manual setting specify tokenizer Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update doc/finetune_parameters.md Signed-off-by: minmingzhu <[email protected]> --------- Signed-off-by: minmingzhu <[email protected]>
intel · Apr 22, 2024 · 4fa89cc · 4fa89cc
1 parent 7f8ed2f
commit 4fa89cc
Showing 1 changed file with 0 additions and 1 deletion.
diff --git a/llm_on_ray/finetune/models/mpt-7b.yaml b/llm_on_ray/finetune/models/mpt-7b.yaml
@@ -1,7 +1,6 @@
 General:
   base_model: mosaicml/mpt-7b
   tokenizer_name: EleutherAI/gpt-neox-20b
-  is_base_model: false
   gpt_base_model: false
   output_dir: /tmp/llm-ray/output
   checkpoint_dir: /tmp/llm-ray/checkpoint