Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

this repository is very, very big... #69

Open
ctb opened this issue Apr 29, 2022 · 10 comments
Open

this repository is very, very big... #69

ctb opened this issue Apr 29, 2022 · 10 comments

Comments

@ctb
Copy link
Contributor

ctb commented Apr 29, 2022

...should we really be storing GFF3 flat files in it?

@ctb
Copy link
Contributor Author

ctb commented Apr 29, 2022

looks like maybe it's mostly the git history that's large. We could consider squashing the history.

@ACharbonneau
Copy link
Contributor

relic from before we moved all the big files to OSF. If the history can be downsized that'd be neat

@ctb
Copy link
Contributor Author

ctb commented May 3, 2022

thx @ACharbonneau -

@abradyIGS could you provide guidance on where would be a good place in the commit history to reset the repo to? date, or specific commit - whatever. preferably someplace after where all the big files were removed :)

@abradyIGS
Copy link
Contributor

I keep my own local mirrors of all the important versions of things, or at least the ones I care about -- so I don't rely on git history for retrieval and therefore don't have an opinion. Deleting history data prior to [anywhere you like that fixes the space issue] is fine with me.

@ctb
Copy link
Contributor Author

ctb commented May 3, 2022

while I appreciate your concern for my concern, that was not my concern 😆 .

when did you move all the big files to OSF, roughly? or do I need to dig through history to find out?

@ACharbonneau
Copy link
Contributor

OSF got big files in August of 2021. Unsure when they would have been deleted here, but presumably around then. I would pick a commit in september or october 2021 and it will likely work

@ACharbonneau
Copy link
Contributor

oh. Uh. So. It looks like the big files were moved to OSF but not actually removed from here...

@abradyIGS
Copy link
Contributor

i should do that, then. looks like our history cutoff will be quite current

@abradyIGS
Copy link
Contributor

argh, it's the developer tools section, i see it now. it's got copies of the big C2M2 CV reference files because it contains the code that generates those big reference files from their respective batches of raw source data. we moved the (generated, finished) reference files to OSF, but i didn't migrate this section: i'll need to do that. gimme a day or two

@abradyIGS
Copy link
Contributor

(i am also going to try to replace some of these big source files with pointers to their third-party locations, so the migrated OSF node should be smaller than what's here on git now)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants