Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setup GCS Metrics for Intake resources #1204

Closed
bendnorman opened this issue Sep 8, 2021 · 1 comment
Closed

Setup GCS Metrics for Intake resources #1204

bendnorman opened this issue Sep 8, 2021 · 1 comment
Assignees
Labels
epic Any issue whose primary purpose is to organize other issues into a group.

Comments

@bendnorman
Copy link
Member

Description

Setup GCS logging for Intake resources. This will allow us to analyze who is accessing our data and which datasets are used most.

If possible, include a:

Motivation

We want to create a logging system to summarize the usage of our published resources. Understanding who uses our resources and how they use them will help us prioritize improvements and can be included in grants.

Intake will be our main mode of access for our outputs so creating a robust logging system is important.

Scope

  • Create a GCP Log sink with persistent storage and inclusion filters that capture logs with
    • IP address
    • Which resources were accessed
  • Create Big Query or Streamlit dashboard with important metrics
    • Number of requests over time
    • Requests by geography
    • Resource type requests over time
@bendnorman bendnorman self-assigned this Sep 8, 2021
@bendnorman bendnorman added the epic Any issue whose primary purpose is to organize other issues into a group. label Sep 8, 2021
@bendnorman
Copy link
Member Author

We no longer use Intake and the usage metrics work has been revived with this PR!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
epic Any issue whose primary purpose is to organize other issues into a group.
Projects
None yet
Development

No branches or pull requests

1 participant