In this checkpoint you will enrich the data you scraped by accessing a public API of your choice, querying it, and storing the response in the database.
- Find a free public API, that has some relevance to your data. You can start here for a list of some public APIs.
- Add to your scraper the ability to query this API and store the responses in your database. You are not allowed to use an API wrapper module.
- There should be some link between the data you scrape from the website and the new data you retrieve from the API. It can be new attributes and properties of the data you already have or new data records that do not exist in the website you scrape. For example if you scrape data about hashtags in instagram you can access twitter api and retrieve data about the same hashtags there.
- Make sure you have sufficient logging (to file) in your project.
- Use this checkpoint to complete unfinished features and fix bugs. The next checkpoints will not involve writing additional code.