Ecom Scraper

Ecom Scraper is a Python project that scrapes product details from e-commerce websites like Amazon, Cartlow, Noon, Popsy, Northladder, Revent, and Revibe. It allows you to extract product information such as title, price, rating, and description, and store it in a structured format for further analysis.

Setup

Step 1: Clone this repository and move to the directory

$ git clone https://github.com/var-rishabh/ecom-scrapper.git

$ cd ecom-scrapper

Step 2: Run the docker container

$ docker-compose up --build -d

Step 3: Go to port localhost:8000/docs

Note 1: To verify the scraped information, you can find the HTML file of all the product pages fetched from the web in the data/HTMl folder.

Note 2: You can check the log file in data/logs