Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bandwidth/Storage issue when rating a number of oss #796

Open
SimoMay opened this issue Mar 30, 2022 · 2 comments
Open

Bandwidth/Storage issue when rating a number of oss #796

SimoMay opened this issue Mar 30, 2022 · 2 comments
Assignees
Labels
question Further information is requested

Comments

@SimoMay
Copy link

SimoMay commented Mar 30, 2022

Hi all, I'm using the YAML config approach to rate a list of GitHub projects.

My issue is every time the calculations run it clones each project to disk, using bandwidth and storage on my server.

Is there a way to stop the cloning part, even if it reduces the confidence level of the rating?

@sourabhsparkala
Copy link
Member

@SimoMay

  • The confidence level of the rating has nothing to do with the cloning.

The reason behind cloning was that we want to restrict the number of calls to GitHub API to as few as possible.

As part of the rating calculation, we try to collect features from a GitHub repo, and it would not make sense to exhaust GitHub token by making multiple API calls to the same project. Hence, to avoid this drawback, we decided to clone the specific repositories and then collect the necessary features directly from the cloned repo.

@sourabhsparkala sourabhsparkala self-assigned this Mar 30, 2022
@sourabhsparkala sourabhsparkala added the question Further information is requested label Mar 30, 2022
@SimoMay
Copy link
Author

SimoMay commented Mar 31, 2022

Hi @sourabhsparkala

Make sense then if the rating is built around getting the code and evaluating it locally. Thanks.

Although I remember I had issues at first compiling and running the tool (java versions mess ups) and one of the issue was the tool couldn't create directory for the repositories, it didn't break the process, got a message stating the error then saying it will continue rating but with a lower score, that's why I associated cloning the repo with a lower score.

The error was errors.JGitInternalException: Creating directories for /work/.fosstars/repositories/x/.git

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants