Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: display helia metrics in probelab #112

Closed
4 of 7 tasks
SgtPooki opened this issue May 4, 2023 · 8 comments
Closed
4 of 7 tasks

feat: display helia metrics in probelab #112

SgtPooki opened this issue May 4, 2023 · 8 comments
Assignees

Comments

@SgtPooki
Copy link
Member

SgtPooki commented May 4, 2023

Note: the probelab side of things is being documented at https://pl-strflt.notion.site/Helia-as-part-of-CMI-4ccbd109ce404f8fa4b4b02fd8af0b3f

Tasks

Preview Give feedback
@SgtPooki
Copy link
Member Author

SgtPooki commented May 5, 2023

Notes from chat with @dennis-tra, @iand, and @achingbrain :

  1. Already doing 3 experiments for DHT (parsec)
    1. Scheduler goes around to nodes 1x1, please provide CID, then waits, and asks other regions to request CID from DHT, and measures latency. (Kubo default config, Kubo with accelerated client, and Kubo with optimistic provide)
      1. We could add a 4th one, which is helia fleet. then we could test providing from helia, and requesting from kubo, and vice versa.
      2. Deployed via docker image (github://plprobelab/parsec)
        1. 4 methods we need to implement in helia docker image: https://github.com/plprobelab/parsec/blob/848e87a7dbb4652b999f855293cd8ac06e69b5f7/pkg/server/server.go#L180-L184
    2. retrieval success rate
    3. provide success rate
    4. time to first provider record

@SgtPooki
Copy link
Member Author

SgtPooki commented May 5, 2023

Note: This should be moved to the js-libp2p repo

@SgtPooki SgtPooki self-assigned this May 5, 2023
@dennis-tra
Copy link

dennis-tra commented May 9, 2023

@SgtPooki @achingbrain

I just finished documenting our parsec measurement tool. I have added a section Implementing a Server outlining the steps you'd need to take to be compatible with the rest of the infra. You need a libp2p host that supports the DHT protocol and these things:

  1. Three HTTP endpoints that control the libp2p host. Documented here as an OpenAPI spec. For a rendering head over to https://editor-next.swagger.io/ -> File -> Import URL... -> paste: https://raw.githubusercontent.com/plprobelab/parsec/main/server.yaml
  2. You need to write an entry to our postgres database with information about which configurations and dependencies the libp2p host uses (this is something I didn't anticipate in our call last Friday but is necessary, unfortunately)
  3. Periodically update a row in our database (details in the repo's readme).

@dennis-tra
Copy link

Hi @SgtPooki, I just wanted to check-in and see if this is still on the roadmap :) I'm asking just out of curiosity because I would love to see a performance comparison 👍

@yiannisbot
Copy link
Member

@SgtPooki quick follow up to see if this will be prioritised from your end so that we include it at probelab.io and allocate any resources to help out and get it to the finish line. Thanks!

@SgtPooki
Copy link
Member Author

SgtPooki commented Nov 2, 2023

This is in progress now and we should see some results in 2-3 hours hopefully.

@SgtPooki SgtPooki moved this to 🏃‍♀️ In Progress in Helia Working Group (inactive) Nov 2, 2023
@BigLep
Copy link
Contributor

BigLep commented Jan 3, 2024

@SgtPooki : what's the relationship between this issue and #275 ?

@SgtPooki
Copy link
Member Author

SgtPooki commented Jan 4, 2024

This is a duplicate, closing this

@SgtPooki SgtPooki closed this as completed Jan 4, 2024
@github-project-automation github-project-automation bot moved this from 🏃‍♀️ In Progress to 🎉 Done in Helia Working Group (inactive) Jan 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

No branches or pull requests

4 participants