To develop an application capable of scrapping data from webpages and to provide visuals to assist the process through a GUI. Implementing a light weight multithreaded interactive application.
Qaahl serves as a minimalist webcrawler providing the basic functionality of a scrapper. A lightweight graphical interface built using pygames.
- Pygame
- Requests
- Beautiful Soup (Bs4)
pip install -r requirements.txt
python3 main.py $URL $flags
$URL |
with the link as the base url |
---|---|
$flags |
with flags e.g. -d 3 performs depth=3 traversal |