[Release-1.26] - Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes

[brandond]

Backport fix for Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes

• Agent config retrieval can cause excessive CPU load on servers during bulk restart of nodes #8862

[endawkins]

Validated on branch 1.26 with commit d00ad9d / version 1.26

Environment Details

Infrastructure

• Cloud
• Hosted

Node(s) CPU architecture, OS, and Version:

Linux ip-172-31-4-130 5.14.21-150400.22-default #1 SMP PREEMPT_DYNAMIC Wed May 11 06:57:18 UTC 2022 (49db222) x86_64 x86_64 x86_64 GNU/Linux
NAME="SLES"
VERSION="15-SP4"
VERSION_ID="15.4"
PRETTY_NAME="SUSE Linux Enterprise Server 15 SP4"
ID="sles"
ID_LIKE="suse"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:suse:sles:15:sp4"
DOCUMENTATION_URL="https://documentation.suse.com/"

Cluster Configuration:

3 servers
3 agents

Additional files

N/A

Testing Steps

1. Copy config.yaml

$ sudo mkdir -p /etc/rancher/k3s && sudo cp config.yaml /etc/rancher/k3s

2. Install k3s
3. Reboot AWS worker instances
4. Verify the worker nodes come back up

Validation Results:

• k3s version used for validation:

k3s -v
k3s version v1.26.11-rc1+k3s1 (d00ad9db)
go version go1.20.11

NAME               STATUS     ROLES                       AGE   VERSION             INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                              KERNEL-VERSION              CONTAINER-RUNTIME
ip-172-31-0-167    NotReady   <none>                      81m   v1.26.11-rc1+k3s1   172.31.0.167    3.141.7.80      SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-0-255    NotReady   <none>                      82m   v1.26.11-rc1+k3s1   172.31.0.255    3.147.104.238   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-14-12    NotReady   <none>                      82m   v1.26.11-rc1+k3s1   172.31.14.12    3.133.154.122   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-15-221   Ready      control-plane,etcd,master   83m   v1.26.11-rc1+k3s1   172.31.15.221   3.144.45.183    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-4-130    Ready      control-plane,etcd,master   85m   v1.26.11-rc1+k3s1   172.31.4.130    18.119.17.94    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-4-23     Ready      control-plane,etcd,master   83m   v1.26.11-rc1+k3s1   172.31.4.23     3.143.24.107    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26

NAME               STATUS   ROLES                       AGE    VERSION             INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                              KERNEL-VERSION              CONTAINER-RUNTIME
ip-172-31-0-167    Ready    <none>                      97m    v1.26.11-rc1+k3s1   172.31.0.167    3.141.7.80      SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-0-255    Ready    <none>                      97m    v1.26.11-rc1+k3s1   172.31.0.255    3.147.104.238   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-14-12    Ready    <none>                      98m    v1.26.11-rc1+k3s1   172.31.14.12    3.133.154.122   SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-15-221   Ready    control-plane,etcd,master   98m    v1.26.11-rc1+k3s1   172.31.15.221   3.144.45.183    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-4-130    Ready    control-plane,etcd,master   101m   v1.26.11-rc1+k3s1   172.31.4.130    18.119.17.94    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26
ip-172-31-4-23     Ready    control-plane,etcd,master   99m    v1.26.11-rc1+k3s1   172.31.4.23     3.143.24.107    SUSE Linux Enterprise Server 15 SP4   5.14.21-150400.22-default   containerd://1.7.7-k3s1.26

Additional context / logs:

N/A