Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indicate weather on the chart somehow #32

Closed
dsjoerg opened this issue Mar 29, 2020 · 12 comments
Closed

Indicate weather on the chart somehow #32

dsjoerg opened this issue Mar 29, 2020 · 12 comments
Assignees

Comments

@dsjoerg
Copy link
Collaborator

dsjoerg commented Mar 29, 2020

Idea from Michele. So that we don't get fooled by drops that are weather related.
So, grab weather data for county somehow, and shade chart regions when it's rainy in that county.

@dsjoerg
Copy link
Collaborator Author

dsjoerg commented Apr 7, 2020

This is no longer experimental. In the briefing books prepared for government they are specifically cross-correlating the visit data to the weather; streamlining this workflow would save time and perhaps give better insights.

We don't want to mistake a change caused by weather for a change caused by people getting sick of staying inside.

@dsjoerg dsjoerg changed the title Add shaded regions to chart for rainy days (experimental) Indicate weather on the chart somehow Apr 7, 2020
@dsjoerg
Copy link
Collaborator Author

dsjoerg commented Apr 7, 2020

Temperature, rain, cloud cover all could be relevant

@rustyconover
Copy link

Is there a preferred provider of historical weather data?

Seems to have the current conditions:
https://www.weather.gov/documentation/services-web-api

It doesn't appear to yet have historical observations.

The Dark Sky API isn't accepting signups any more.

What lat/long locations are necessary to log?

@ajanian
Copy link
Member

ajanian commented Apr 9, 2020

Great questions. I think we really need weather data by state and by county - at least that is what we are plotting today. I think there is probably a dataset that has a zip to use for a county/state or a lat long for a county/state. I think we aren't trying to get tooooo accurate so something close will work. I think there have been some ideas for weather datasets floating around here. @mattjacobus and @dsjoerg probably know some. If not, ask JeremyB in the slack - he's the all knowing data guy

@slyapustin
Copy link

I think we can use OpenWeather Historical Data: https://openweathermap.org/history

@rustyconover
Copy link

All of that historical weather seems to be part of a priced offering. I'm happy to start archiving the current forecasts though.

https://openweathermap.org/price

@slyapustin
Copy link

I think we need to create some rating based on weather conditions.
For example: Walkability: 100% (No rain/snow, no strong wind and not too hot/cold) - 0% (Strong rain/snow, storm and etc).

I can create an API to get data from the data source and transfer it to that rating (need to work on the formula).

@dsjoerg
Copy link
Collaborator Author

dsjoerg commented Apr 15, 2020

Hmm... I suppose with more past data about mobility and weather, we could fit a Walkability model per state to understand how different parts of USA react to different weather conditions.

@dsjoerg
Copy link
Collaborator Author

dsjoerg commented Apr 15, 2020

But the simpler thing for now would be to show temperature and precipitation below the chart, and then people looking at it already know how from experience how people in that region react to any given precipitation/temperature combination.

@slyapustin
Copy link

Found another data source: https://water.weather.gov/precip/download.php
It's in GRB and here is Python library to work with that data https://github.com/jswhit/pygrib

@ajanian ajanian self-assigned this May 8, 2020
@ajanian
Copy link
Member

ajanian commented May 8, 2020

Here is the punchlist as I see it to get weather data released.

  1. We need to set up the ETL jobs to run on GCP (@markroth8 to help/review)
  2. We need to backfill the historic weather data by copying from @anusheel bucket(s) to ours (@markroth8 to help/review)
  3. We need to integrate the javascript and accept PR Weather Data Plots #168 (@ajanian to do)

@ajanian
Copy link
Member

ajanian commented Sep 30, 2020

we have the puchlist issue #178 so this is done

@ajanian ajanian closed this as completed Sep 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants