Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nfs: calculate desired memory fraction for correct memory allocation #7529

Merged
merged 1 commit into from
Mar 11, 2024

Conversation

kofemann
Copy link
Member

@kofemann kofemann commented Mar 7, 2024

Motivation:
Grizzly memory management uses heap memory size fraction even if direct memory is used.

eclipse-ee4j/grizzly#2201

Moreover, for each memory slice (a memory segment per thread) allocates at least x16 chunks, which ends up at 16MB per slice (with 1MB chunk)

Modification:
as dCache needs 2 * #Cores * maxIObuf memory, pre-calculate the required amount of direct memory and the corresponding fraction in relation to heap. Initialise the memory pool with 1/16 of the desired slice size to compensate memory allocator internal x16 increase.

Result:
dCache starts with 256m of direct memory (we still have xroot mover)

Fixes: #7522
Acked-by: Svenja Meyer
Acked-by: Lea Morschel
Target: master, 9.2
Require-book: no
Require-notes: yes
(cherry picked from commit 8f3b984)

Motivation:
Grizzly memory management uses heap memory size fraction even if direct
memory is used.

eclipse-ee4j/grizzly#2201

Moreover, for each memory slice (a memory segment per thread) allocates
at least x16 chunks, which ends up at 16MB per slice (with 1MB chunk)

Modification:
as dCache needs `2 * #Cores * maxIObuf` memory, pre-calculate the
required amount of direct memory and the corresponding fraction
in relation to heap. Initialise the memory pool with 1/16 of the
desired slice size to compensate memory allocator internal x16
increase.

Result:
dCache starts with 256m of direct memory (we still have xroot mover)

Fixes: dCache#7522
Acked-by: Svenja Meyer
Acked-by: Lea Morschel
Target: master, 9.2
Require-book: no
Require-notes: yes
(cherry picked from commit 8f3b984)
Signed-off-by: Tigran Mkrtchyan <[email protected]>
@mksahakyan mksahakyan merged commit 58cc1f3 into dCache:9.2 Mar 11, 2024
1 check passed
@kofemann kofemann deleted the issue7522-9.2 branch March 25, 2024 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants