Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

infra activities for eval 7 kickoff #1961

Closed
6 of 8 tasks
mwartell opened this issue Jul 18, 2023 · 4 comments
Closed
6 of 8 tasks

infra activities for eval 7 kickoff #1961

mwartell opened this issue Jul 18, 2023 · 4 comments
Assignees

Comments

@mwartell
Copy link
Contributor

mwartell commented Jul 18, 2023

  • update docx invitation
  • release new armory-upload with eval7 s3 destination folder
  • update AWS IAM perms to allow write-only to eval7 folder
  • reconcile (adopt in toto?) Donizetti's master email list
  • backup and clear DynamoDB
  • create Armory v0.18.0 AMI for evalboxes
  • figure out better model-weights mechanism
  • implement create a serverless app to copy model_weights to destination directory #1962
@mwartell mwartell self-assigned this Jul 18, 2023
@mwartell
Copy link
Contributor Author

Armory-upload currently routes submitted model weights into an evalX folder (with everything else). But armory only knows to look for them under model-weights . I think in eval6 I sometimes copied the weights into model-weights so armory could find them easily. Going forward, what do you prefer: updating armory to search deeper (might be tricky to tell it which eval folder to look in), just having people download the weights themselves, or something else?

@swsuggs
Copy link
Contributor

swsuggs commented Jul 18, 2023

Hey that was my question . . .

But what if we just have armory-upload put them in both spots, then we can delete model-weights when no longer needed?

@mwartell
Copy link
Contributor Author

We are making AWS Lambda copy from eval?/CODE/email/model-weights/foo.pt to model-weights/foo.pt upon upload under #1962

@swsuggs
Copy link
Contributor

swsuggs commented Oct 18, 2023

Eval 7 is completed.

@swsuggs swsuggs closed this as completed Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants