Refactoring of the HNAP to GeoCore translation lambda

[indiciumx]

Ticket to track progress and issues related to the refactoring of the HNAP to GeoCore translation lambda

[indiciumx]

History from RedMine

Updated by Bo Lu 8 months ago
Status changed from New to In Progress
#2Updated by Bo Lu 8 months ago
Target version set to 1.0.5
#3Updated by Pascal Vautour 7 months ago
Comment Edit
The new function is completed. it is available here:

• https://ca-central-1.console.aws.amazon.com/lambda/home?region=ca-central-1#/functions/geoCore_Transformation_Pascal_Nodejs_14?tab=code

There is still some work to be done to be able to add it to the next deployment:

1. rerun the function for all entries in the HNAP bucket
2. rerun aws glue and generate new schema for the new geojson files created
3. fix any athena query that would be broken by schema changes
4. bring the changes into staging and, eventually, prod

@bo Lu, would you remember how to do #2?

Thanks,

#4Updated by Bo Lu 7 months ago
Comment Edit
AWS Glue is run on the parquet file to generate the schema. Can you point me to the the bucket with the new geojson files?

#5Updated by Pascal Vautour 7 months ago
Comment Edit
For now the function does not write the files to a bucket. It simply returns the resulting geojson as a response. It should be easy to just write that geojson to a file in a bucket though.

I can have a look at doing that.