Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

broken link checkers should output results to a file during runtime and not wait until the end of the program #4

Open
johncoleman83 opened this issue Oct 6, 2018 · 0 comments
Labels
hacktoberfest digital ocean hacktoberfest

Comments

@johncoleman83
Copy link
Owner

johncoleman83 commented Oct 6, 2018

The goal is to write data during runtime in the same way that it is currently done for the 2 scrape_emails_and_social_media.py files. This is useful for the events of errors during runtime you don't lose all your results. Also, sometimes memory runs out when you are scraping huge websites so it is important to have your findings documented.

Developer to take this should model after the current implementation. If issue #1 is completed, then it will be just a matter of importing the needed modules.

@johncoleman83 johncoleman83 added the hacktoberfest digital ocean hacktoberfest label Oct 6, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hacktoberfest digital ocean hacktoberfest
Projects
None yet
Development

No branches or pull requests

1 participant