Refactor: RAM optimizations

[dd84ai]

Go with RAM profiler https://medium.com/compass-true-north/memory-profiling-a-go-service-cd62b90619f9

• Find other memory profiler configuration?
  • https://www.codereliant.io/memory-leaks-with-pprof/ is nice starting point guide
• deallocate Mapped configs after u no longer need them
• Try to consume less running RAM by using Gob to store already exported data. https://pkg.go.dev/encoding/gob

Try to find duplicates of AppData.

• Check it is present twice in inuse_objects profiling
• Try running without darkrelay

[dd84ai]

i have as a plan, to go with Memory Profiler and deallocate all not necessary data.

Potentially even not storing some data that i could export on a fly. Or caching if necessary already exported version on a disk in gob

Expore RAM compressions in addition like https://github.com/ostafen/zipcache

[dd84ai]

https://www.benburwell.com/posts/flame-graphs-for-go-with-pprof/
https://sathishvj.medium.com/flamegraphs-for-code-optimization-with-golang-and-speedscope-80c20725fdd2
Task to extend later. found how to build memory flamegraphs for Golang. With this technology I will be able to do intensive RAM optimizations

[dd84ai]

Optimize Graph output, by converting Dense to only needed Scarse matrix stuff. Check how much it will save, in theory a lot of RAM will be saved here.