Skip to content

Commit

Permalink
Added missing import
Browse files Browse the repository at this point in the history
  • Loading branch information
noamgat committed Sep 28, 2024
1 parent 0b4f308 commit 48bc632
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions tests/common.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,12 @@
from pstats import Stats
from typing import Optional
from transformers import AutoTokenizer, PreTrainedTokenizerBase

from lmformatenforcer import CharacterLevelParser
from lmformatenforcer.exceptions import LMFormatEnforcerException
from lmformatenforcer.tokenenforcer import TokenEnforcer, TokenEnforcerTokenizerData
from lmformatenforcer.integrations.transformers import build_token_enforcer_tokenizer_data

import logging


_tokenizer: Optional[PreTrainedTokenizerBase] = None
_tokenizer_data: Optional[TokenEnforcerTokenizerData] = None
Expand Down

0 comments on commit 48bc632

Please sign in to comment.