We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi, I want to access
CONFIG_MAP["log“]
to record the number of steps took, but after I try both
import lade ... lade.save_log()
or
from lade.utils import save_log ... save_log()
It seems all says that "save_log" does not exist in lade. same happens for "log_history"
Also, I have tryed to print want comes with lade, and it seems they are both not there:
import lade print(dir(lade)) import lade.utils print(dir(lade.utils))
And the output is:
['__builtins__', '__cached__', '__doc__', '__file__', '__loader__', '__name__', '__package__', '__path__', '__spec__', 'augment_all', 'augment_generate', 'augment_llama', 'config_lade', 'decoding', 'models', 'utils'] ['AutoConfig', 'AutoModelForCausalLM', 'AutoTokenizer', 'CONFIG_MAP', 'FUNC_MAP', 'GenerationMixin', '__builtins__', '__cached__', '__doc__', '__file__', '__loader__', '__name__', '__package__', '__spec__', 'augment_all', 'augment_generate', 'augment_llama', 'config_lade', 'get_hf_model', 'get_model', 'greedy_search_proxy', 'llama', 'modeling_llama', 'os', 'torch']
The text was updated successfully, but these errors were encountered:
It turns out, if using
pip install lade
Then these functions cannot be accessed, but if just cloning the repo
git clone https://github.com/hao-ai-lab/LookaheadDecoding.git cd LookaheadDecoding pip install -r requirements.txt pip install -e .
Then in minimal.py it can be used freely
minimal.py
I will leave this open as adding this feature to lade package would be great
Sorry, something went wrong.
No branches or pull requests
Hi,
I want to access
to record the number of steps took, but after I try both
or
It seems all says that "save_log" does not exist in lade. same happens for "log_history"
Also, I have tryed to print want comes with lade, and it seems they are both not there:
And the output is:
The text was updated successfully, but these errors were encountered: