README.md

Requirements

• Python 3.4+

Dependencies

• beautifulsoup4
• lxml
• numpy
• pandas
• pyodbc
• requests
• SQLAlchemy
• fake-useragent

Usage

Create an environment

$ conda create -n dev

Activate the new environment

# on windows
$ activate dev

# on Linux or macOS
$ source activate dev

Installation dependency

$ pip install -r requirements.txt

Run

$ python main.py