Skip to content

Commit

Permalink
feat(databricks): add hour stamp to bronze tables
Browse files Browse the repository at this point in the history
  • Loading branch information
pbullhove committed Oct 3, 2024
1 parent d2e3194 commit d2709c4
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions databricks/Havvarsel - Ingest as Bronze.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,8 +29,8 @@ def fetch_ocean_temperature_preditions(depth_index, lat, lon):

connect_to_adls()

fetch_date = datetime.now().strftime("%Y-%m-%d")
bronze_df_file_name = f"bronze/hav_temperature_projection_{fetch_date}" # have a new bronze for each fetch date
fetch_time = datetime.now().strftime("%Y-%m-%d:%H")
bronze_df_file_name = f"bronze/hav_temperature_projection_{fetch_time}" # have a new bronze for each fetch date


dbutils.fs.rm(f"{get_adls_folder_path()}/{bronze_df_file_name}", recurse=True) # delete old in order to remove duplicates
Expand Down

0 comments on commit d2709c4

Please sign in to comment.