Welcome to the Linux Foundation Forum!

LFS258 - cp and worker nodes in "NotReady" / Unable to connect with API Server.

Todd Gill
Todd Gill Posts: 15

student@cp:~$ kubectl get nodes
NAME STATUS ROLES AGE VERSION
cp NotReady control-plane 123d v1.34.1
worker NotReady 122d v1.34.1
student@cp:~$

cilium-operator not terminating, remains pending ... coredns Pending ....

student@cp:~$ kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system cilium-cl9hw 1/1 Terminating 0 122d
kube-system cilium-envoy-qpzz4 1/1 Running 0 122d
kube-system cilium-envoy-rml6q 1/1 Running 0 123d
kube-system cilium-f5gj5 1/1 Terminating 0 123d
kube-system cilium-operator-5bc8769866-8gd5v 0/1 Terminating 0 27m
kube-system cilium-operator-698c9d76d8-zbw67 0/1 Pending 0 26m
kube-system cilium-operator-74c57d79bd-c9mjx 0/1 Pending 0 8m39s
kube-system cilium-operator-74c57d79bd-v64n2 0/1 Pending 0 8m39s
kube-system coredns-66bc5c9577-8pxjv 0/1 Pending 0 5d2h
kube-system coredns-66bc5c9577-zl7pb 0/1 Pending 0 5d2h
kube-system etcd-cp 1/1 Running 1 (118d ago) 118d
kube-system kube-apiserver-cp 1/1 Running 1 (118d ago) 118d
kube-system kube-controller-manager-cp 1/1 Running 0 118d
kube-system kube-proxy-898dk 1/1 Running 0 118d
kube-system kube-proxy-9h87p 1/1 Running 0 118d
kube-system kube-scheduler-cp 1/1 Running 0 118d
kube-system metrics-server-799f7ccf68-8fmsg 1/1 Terminating 0 55d
kube-system metrics-server-799f7ccf68-c9n7v 0/1 Pending 0 7d
student@cp:~$

Output from kubelet :

kubelet.service - kubelet: The Kubernetes Node Agent
Loaded: loaded (/usr/lib/systemd/system/kubelet.service; enabled; preset: enabled)
Drop-In: /usr/lib/systemd/system/kubelet.service.d
└─10-kubeadm.conf
Active: active (running) since Tue 2026-07-14 19:25:01 UTC; 1h 39min ago
Docs: https://kubernetes.io/docs/
Main PID: 327828 (kubelet)
Tasks: 13 (limit: 9429)
Memory: 36.7M (peak: 37.2M)
CPU: 2min 58.514s
CGroup: /system.slice/kubelet.service
└─327828 /usr/bin/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf --config=/var/lib/kubelet/config.yaml --pod-infra-container-image=registry.k8s.io/pause:3.10

Jul 14 21:04:21 cp.us-west2-a.c.orbital-cistern-281415.internal kubelet[327828]: E0714 21:04:21.236648 327828 reconstruct.go:189] "Failed to get Node status to reconstruct device paths" err="nodes \"cp.us-west2-a.c.orbital-cistern-281415.internal\" is forbidden: User \"system:node:cp\" cannot get resource \"nodes\" in API group \"\" at the cluster scope: node 'cp' cannot read 'cp.us-west2-a.c.orbital-cistern-281415.internal', only its own Node object"

Comments

  • Flavia
    Flavia Posts: 2,640

    Hi @Todd Gill ,

    This post was moved to the correct forum. Please note that details on forum posting best practices, as well as the link to the correct forum post, are located in the course introduction.

    Can you please advise what lab is this related to?

    Regards,
    Flavia

  • Todd Gill
    Todd Gill Posts: 15

    Hi Flavia,

    Sorry for posting in the wrong forum. There is no category for LFS258 in the drop down, how would post there?

  • Flavia
    Flavia Posts: 2,640

    Hi Todd,

    We have recently moved away from using individual course-based forums to area of interest-based forums. LFS258 falls under the Cloud & Containers Training Forum. Please check the Course Introduction chapter, the Discussion Forum section, for specific details on how to use the forum, as well as the correct link. Following the recommended best practices ensures that your post is viewed by our moderators.

    Please advise the exact lab your post is related to.

    Regards,
    Flavia

Categories

Upcoming Training