Built a web application that scrapes various websites for data related to the Mission to Mars and displays the information in a single HTML page.
- Completed initial scraping using Jupyter Notebook, BeautifulSoup, Pandas, and Requests/Splinter.
- MongoDB was used to store with Flask templating to create a new HTML page that displays all of the information that was scraped from the URLs above
- Used Splinter to navigate the sites when needed and BeautifulSoup to help find and parse out the necessary data.
- Pymongo for CRUD applications for the database.
- Used Bootstrap to structure your HTML template.
https://github.com/wention/BeautifulSoup4 https://splinter.readthedocs.io/en/latest/ https://pymongo.readthedocs.io/en/stable/ https://docs.mongodb.com/manual/core/document/ https://getbootstrap.com/docs/4.1/getting-started/introduction/