Skip to content

Soumya-Patil/Web-Scraping-Challenge

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

43 Commits
 
 
 
 

Repository files navigation

Built a web application that scrapes various websites for data related to the Mission to Mars and displays the information in a single HTML page.
The following outlines what was done to achieve this.
  • Completed initial scraping using Jupyter Notebook, BeautifulSoup, Pandas, and Requests/Splinter.
  • MongoDB was used to store with Flask templating to create a new HTML page that displays all of the information that was scraped from the URLs above
  • Used Splinter to navigate the sites when needed and BeautifulSoup to help find and parse out the necessary data.
  • Pymongo for CRUD applications for the database.
  • Used Bootstrap to structure your HTML template.
Sources used :

https://github.com/wention/BeautifulSoup4 https://splinter.readthedocs.io/en/latest/ https://pymongo.readthedocs.io/en/stable/ https://docs.mongodb.com/manual/core/document/ https://getbootstrap.com/docs/4.1/getting-started/introduction/

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published