[Release-1.25] - Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes

[brandond]

Backport fix for Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes

• Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes #8862

[endawkins]

Validated on branch 1.25 with commit d0bc34c / version 1.25

Environment Details

Infrastructure

• Cloud
• Hosted

Node(s) CPU architecture, OS, and Version:

Linux ip-172-31-4-130 5.14.21-150400.22-default #1 SMP PREEMPT_DYNAMIC Wed May 11 06:57:18 UTC 2022 (49db222) x86_64 x86_64 x86_64 GNU/Linux
NAME="SLES"
VERSION="15-SP4"
VERSION_ID="15.4"
PRETTY_NAME="SUSE Linux Enterprise Server 15 SP4"
ID="sles"
ID_LIKE="suse"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:suse:sles:15:sp4"
DOCUMENTATION_URL="https://documentation.suse.com/"

Cluster Configuration:

3 servers
3 agents

Additional files

N/A

Testing Steps

1. Copy config.yaml

$ sudo mkdir -p /etc/rancher/k3s && sudo cp config.yaml /etc/rancher/k3s

2. Install k3s
3. Reboot AWS worker instances
4. Verify the worker nodes come back up

Validation Results:

• k3s version used for validation:

k3s -v
k3s version v1.25.16-rc1+k3s1 (d0bc34ce)
go version go1.20.10

NAME               STATUS     ROLES                       AGE   VERSION             INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                              KERNEL-VERSION              CONTAINER-RUNTIME
ip-172-31-0-29     Ready      control-plane,etcd,master   79m   v1.25.16-rc1+k3s1   172.31.0.29     18.191.208.11   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-10-155   NotReady   <none>                      77m   v1.25.16-rc1+k3s1   172.31.10.155   18.119.105.29   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-12-48    NotReady   <none>                      77m   v1.25.16-rc1+k3s1   172.31.12.48    3.133.117.232   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-14-234   Ready      control-plane,etcd,master   81m   v1.25.16-rc1+k3s1   172.31.14.234   3.21.12.65      SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-8-29     Ready      control-plane,etcd,master   78m   v1.25.16-rc1+k3s1   172.31.8.29     18.189.184.69   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-9-245    NotReady   <none>                      77m   v1.25.16-rc1+k3s1   172.31.9.245    3.15.203.150    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1

NAME               STATUS   ROLES                       AGE   VERSION             INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                              KERNEL-VERSION              CONTAINER-RUNTIME
ip-172-31-0-29     Ready    control-plane,etcd,master   80m   v1.25.16-rc1+k3s1   172.31.0.29     18.191.208.11   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-10-155   Ready    <none>                      79m   v1.25.16-rc1+k3s1   172.31.10.155   18.119.105.29   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-12-48    Ready    <none>                      79m   v1.25.16-rc1+k3s1   172.31.12.48    3.133.117.232   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-14-234   Ready    control-plane,etcd,master   83m   v1.25.16-rc1+k3s1   172.31.14.234   3.21.12.65      SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-8-29     Ready    control-plane,etcd,master   80m   v1.25.16-rc1+k3s1   172.31.8.29     18.189.184.69   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1
ip-172-31-9-245    Ready    <none>                      79m   v1.25.16-rc1+k3s1   172.31.9.245    3.15.203.150    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1

Additional context / logs:

N/A