Skip to content

Commit

Permalink
remove wrong rpint
Browse files Browse the repository at this point in the history
  • Loading branch information
samsja committed Sep 24, 2024
1 parent 3b8c4ba commit ba18cab
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions src/zeroband/train.py
Original file line number Diff line number Diff line change
Expand Up @@ -172,9 +172,6 @@ def train(config: Config):
input_ids = batch["input_ids"].to("cuda")
labels = batch["labels"].to("cuda")

logger.debug(f"input_ids: {input_ids[0][0:10]}")
logger.debug(f"labels: {labels[0][0:10]}")

with model.no_sync() if is_accumulating else nullcontext():
logits = model(tokens=input_ids).contiguous()
flatten_logits = rearrange(logits, "b seq vocab -> (b seq) vocab")
Expand Down

0 comments on commit ba18cab

Please sign in to comment.