Project information

  • Category: Data Analysis
  • Reason: Fun / Practice
  • Project date: February, 2020
  • Tech: BeautifulSoup4 4.9.3, Bootstrap 3.3.7, DateTime 4.3, Flask 1.1.2, Flask-PyMongo 2.3.0, html5lib 1.1, Jupyter Notebook 6.1.4, MongoDB 4.4.2, Numpy 1.19.3, Pandas 1.1.4, PyMongo 3.11.2, Splinter 0.14.0, webdriver-manager 3.2.2.
  • Project Details: Shawn's 'Mission-to-Mars' Project Overview

Mission to Mars - Web Scraping with HTML/CSS

Main Objectives

  1. Gain familiarity with and use HTML elements, as well as class and id attributes, to identify content for web scraping.

  2. Use BeautifulSoup and Splinter to automate a web browser and perform a web scrape.

  3. Create a MongoDB database to store data from the web scrape.

  4. Create a web application with Flask to display the data from the web scrape.

  5. Use Bootstrap components to polish and customize the website.