Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incomplete data coming through #543

Open
stucka opened this issue Aug 15, 2023 · 1 comment
Open

Incomplete data coming through #543

stucka opened this issue Aug 15, 2023 · 1 comment

Comments

@stucka
Copy link
Contributor

stucka commented Aug 15, 2023

Bot sent through something with no state postal code, even
CHARTER COMMUNICATIONS LLC - CENTRAL REGION
Notice date: 2023-07-26
FALLON HEALTH WEINBERG, INC. - WESTERN REGION
Notice date: 2023-07-20

@stucka
Copy link
Contributor Author

stucka commented Aug 16, 2023

The initial problem is likely one with warn-bot, but it highlighted another.

New York's scraper is combining fields, such as
Charter Communications LLC - Central Region

Company name can be separated as
" - ".join(companyname.split(" - ")[:-1]

Region name can be separated as
companyname.split(" - ")[-1]
or
companyname.split(" - ")[-1].replace(" Region", "")

Not sure if that would duplicate data n the database as the company name would shift considerably.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant