Skip to content

Commit

Permalink
test wrong annot
Browse files Browse the repository at this point in the history
  • Loading branch information
masahi committed Dec 4, 2023
1 parent f0dd6d3 commit c1be6d1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion serve/mlc_serve/run.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ def create_engine(
if args.use_staging_engine:
return StagingInferenceEngine(
tokenizer_module=HfTokenizerModule(model_artifact_path),
model_module_loader=PagedCacheModelModule, # type: ignore
model_module_loader=PagedCacheModelModule,
model_module_loader_kwargs={
"model_artifact_path": model_artifact_path,
"engine_config": engine_config,
Expand Down

0 comments on commit c1be6d1

Please sign in to comment.