Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize Cell Footprint Processing with Database Caching #1

Closed
dcromp opened this issue Jan 21, 2025 · 1 comment
Closed

Optimize Cell Footprint Processing with Database Caching #1

dcromp opened this issue Jan 21, 2025 · 1 comment

Comments

@dcromp
Copy link

dcromp commented Jan 21, 2025

Currently, the system requires us to provide cell metadata for each time period (day/month/year) we want to process, even though the majority of cells' metadata and footprints remain unchanged. This leads us to recalculating the same cell footprints for each day, which is computationally intensive.

One potential solution could be implementing a database to store cell footprints. This would allow us to maintain a cache of footprint data and only update the calculations when new metadata indicates a change in a cell's properties. We could have the system compare incoming metadata against stored values and trigger recalculations only for cells that have actually changed. Would this approach help reduce the processing overhead.

@steso-nommon
Copy link
Collaborator

Thank you for bringing up this topic. We will include it in our to-do list alongside other improvements currently under evaluation. At the moment, our focus for the next releases is on adding new functionalities (such as tourism use cases) and addressing other scalability challenges. However, we will certainly take your idea into consideration for future developments. Thank you for your contribution.

@steso-nommon steso-nommon closed this as not planned Won't fix, can't repro, duplicate, stale Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants