Skip to content

Commit

Permalink
REF: stop after s3 bucket.
Browse files Browse the repository at this point in the history
  • Loading branch information
dullibri committed Jan 12, 2024
1 parent 8af62b8 commit 2455400
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 7 deletions.
2 changes: 1 addition & 1 deletion setup.cfg
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[metadata]
name = immo-bee
version = 1.0.8
version = 1.0.9
author = Dirk Ulbricht
author_email = [email protected]
description = Scrapes housing data from German immowelt and returns table.
Expand Down
15 changes: 9 additions & 6 deletions src/immo_bee/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -75,12 +75,15 @@ class inputs:
for url in start_urls:
process_url(url, arguments)

df = load_and_prepare_data(arguments)

if locations:
return df
else:
save_data(df, arguments.data_folder)
no_s3_given = len(arguments.s3_bucket) == 0
if no_s3_given:
print("wrong way")
df = load_and_prepare_data(arguments)

if locations:
return df
else:
save_data(df, arguments.data_folder)


if __name__ == "__main__":
Expand Down

0 comments on commit 2455400

Please sign in to comment.