Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
  • Loading branch information
aa-sikkkk committed Sep 19, 2024
2 parents 253779b + 205c014 commit a40c8aa
Show file tree
Hide file tree
Showing 4 changed files with 15 additions and 5 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/django.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ jobs:
working-directory: web
run: |
python -m pip install --upgrade pip
pip install -r web/requirements.txt
pip install -r requirements.txt
- name: Run migrations
working-directory: web
Expand Down
12 changes: 10 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ WebScrape is a simple yet powerful Python-based web scraping tool that allows us
- Displays existing scraped websites in a user-friendly table format.
- Allows alias names for websites to manage and store scraped data.
- Handles multiple websites and retains a history of scrapes.
- Web Version as well as CLI Version is available.

## Google Collab
You can find the google notebook from: [link](https://colab.research.google.com/drive/1t03WODhStp3oYeFthi4r9gZuNXCR31lE?usp=sharing)
Expand Down Expand Up @@ -41,7 +42,8 @@ python scrap.py
##
Data Storage

![1_poXvWu--59Gd64sRktAQGQ](https://github.com/user-attachments/assets/15011f46-de61-487c-85b2-c433c433b9a5)




```
Expand All @@ -67,8 +69,14 @@ Data Storage
```

## Web Version of the Project.
The Project is powered by Django for web version.

![Screenshot 2024-09-18 120647](https://github.com/user-attachments/assets/389721fb-4a19-4c0c-9c90-e0dbab49c959)
![Screenshot 2024-09-18 120628](https://github.com/user-attachments/assets/06ec5a10-7210-4e00-b9c3-5c8a749048b5)

## License
This project is licensed under the MIT License. See the LICENSE file for more details.
This project is licensed under the MIT [License](LICENSE). See the LICENSE file for more details.

## Contributing
Feel free to fork the project and submit pull requests! If you encounter any issues, you can open an issue on the repository.
Expand Down
3 changes: 2 additions & 1 deletion requirements.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
django==5.1.1
async-generator==1.10
attrs==21.4.0
beautifulsoup4==4.10.0
Expand All @@ -22,4 +23,4 @@ trio-websocket==0.9.2
urllib3==1.26.8
wcwidth==0.2.5
wsproto==1.1.0
html5lib==1.1
html5lib==1.1
3 changes: 2 additions & 1 deletion web/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
django==5.1.1
async-generator==1.10
attrs==21.4.0
beautifulsoup4==4.10.0
Expand All @@ -21,4 +22,4 @@ trio==0.20.0
trio-websocket==0.9.2
urllib3==1.26.8
wcwidth==0.2.5
wsproto==1.1.0
wsproto==1.1.0

0 comments on commit a40c8aa

Please sign in to comment.