Skip to content

Issues: mlfoundations/dclm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

15 Open 55 Closed
15 Open 55 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

400M Model Weights
#105 opened Jan 14, 2025 by ethanlshen
Dataset for training 1B-5x model in Table 1
#104 opened Dec 29, 2024 by LeoXinhaoLee
denied access while copying shards from aws s3 bucket
#103 opened Dec 13, 2024 by emirkaan5
3
Searching DCLM-baseline
#101 opened Dec 5, 2024 by chtmp223
bloom filter occupied 90 % of memory on server with 836Gb available ram
#99 opened Nov 27, 2024 by ethany21
Build my own model and use DCLM-1B training script and dataset.
#95 opened Nov 17, 2024 by windbar778
tokenization memory usage
#88 opened Oct 13, 2024 by brian-ham
1
Availability of DCLM data mixes used in figure 3
#77 opened Sep 13, 2024 by IanMagnusson
@Mivg
4
The dataset for training fastText OH-2.5 +ELI5 text classifier
#75 opened Sep 10, 2024 by yqy2001
@jeffreywpli
3
Training data of model-based filtering
#74 opened Sep 6, 2024 by Yu-Shi
@Mivg
3
deduplication removes 98% of my data
#71 opened Sep 2, 2024 by Yu-Shi
@revbucket @Mivg
2
What is the pretrain scripts?
#68 opened Aug 30, 2024 by mathfinder
@GeorgiosSmyrnis
12
TypeError: Couldn't cast array of type
#66 opened Aug 28, 2024 by shizhediao
@GeorgiosSmyrnis
2
Any plans to release pools after refinedweb heuristic filtering + dedup?
#59 opened Aug 19, 2024 by CodeCreator
@GeorgiosSmyrnis
9
Dedup methods
#54 opened Aug 12, 2024 by ch-shin
@GeorgiosSmyrnis
1
ProTip! Exclude everything labeled bug with -label:bug.