Skip to content

anmol27katyani/Public-API-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Public-APIs-List-Crawler---Assignment

This is my submission for Data Engineer assignment.

Database Used is MySQL and Total entries created will be 640 in final table

  • Your code should follow concept of OOPS
  • Support for Authentication & token expiration
  • Support for Pagination to get all data
  • Support for Rate limiting
  • Crawl all API entries for all categories
  • Support for Docker
  • All Points completed

Approximate time to build docker image is 16 mins to fetch and create Database, script runnning time may vary depending upon docker images and internet connection.

Releases

No releases published

Packages

No packages published