Network unavailable after worker joins control-plane
I am two running VMs on VirtualBox (network set as bridge-adapter) for the worker and control-plane nodes
I am having problems with the first lab in creating a cluster
After running the join command on the worker node I notice it joins the cluster but never becomes ready. The describe node command indicates the worker node has stopped publishing status.
At that point I noticed I could no longer ping from either node to the other. Any clues?
FYI:
worker-node IP: 10.0.0.55
cp-node IP: 10.0.0.139
$sudo ip route default via 10.0.0.1 dev enp0s3 proto dhcp metric 100 10.0.0.0/24 via 10.0.0.171 dev cilium_host proto kernel src 10.0.0.171 10.0.0.0/24 dev enp0s3 proto kernel scope link src 10.0.0.139 metric 100 10.0.0.171 dev cilium_host proto kernel scope link 169.254.0.0/16 dev enp0s3 scope link metric 1000
Name: kube4
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=kube4
kubernetes.io/os=linux
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 29 Jun 2024 16:03:16 +0930
Taints: node.kubernetes.io/unreachable:NoExecute
node.cilium.io/agent-not-ready:NoSchedule
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: kube4
AcquireTime: <unset>
RenewTime: Sat, 29 Jun 2024 16:03:46 +0930
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Sat, 29 Jun 2024 16:03:26 +0930 Sat, 29 Jun 2024 16:04:29 +0930 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Sat, 29 Jun 2024 16:03:26 +0930 Sat, 29 Jun 2024 16:04:29 +0930 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Sat, 29 Jun 2024 16:03:26 +0930 Sat, 29 Jun 2024 16:04:29 +0930 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Sat, 29 Jun 2024 16:03:26 +0930 Sat, 29 Jun 2024 16:04:29 +0930 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 10.0.0.55
Hostname: kube4
Capacity:
cpu: 2
ephemeral-storage: 19947120Ki
hugepages-2Mi: 0
memory: 4005976Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 18383265762
hugepages-2Mi: 0
memory: 3903576Ki
pods: 110
System Info:
Machine ID: 138ec1e0ef054b269929f06da17de685
System UUID: 224bb1df-fdf8-064a-bdc1-d79a8e4d8d50
Boot ID: 46eddc31-2179-4f0b-b882-38afe5c7425f
Kernel Version: 5.15.0-113-generic
OS Image: Ubuntu 20.04.6 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.18
Kubelet Version: v1.30.1
Kube-Proxy Version: v1.30.1
PodCIDR: 20.0.1.0/24
PodCIDRs: 20.0.1.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system cilium-2psgw 100m (5%) 0 (0%) 10Mi (0%) 0 (0%) 62m
kube-system kube-proxy-trgz7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 62m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%) 0 (0%)
memory 10Mi (0%) 0 (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events: <none>
Answers
-
Perhaps it has something to do with the Cilium PodCIDR conflicting with the host CIDR. If so how does one change the Cilium PodCIDR
0 -
Hi @harriotj,
Please provide the outputs of the following commands:
kubectl get nodes -o widekubectl get pods -A -o wideRegards,
-Chris0
Categories
- All Categories
- 158 LFX Mentorship
- 158 LFX Mentorship: Linux Kernel
- 850 Linux Foundation IT Professional Programs
- 389 Cloud Engineer IT Professional Program
- 186 Advanced Cloud Engineer IT Professional Program
- 88 DevOps Engineer IT Professional Program
- 156 Cloud Native Developer IT Professional Program
- 152 Express Training Courses & Microlearning
- 149 Express Courses - Discussion Forum
- 3 Microlearning - Discussion Forum
- 7.2K Training Courses
- 50 LFC110 Class Forum - Discontinued
- 74 LFC131 Class Forum - DISCONTINUED
- 56 LFD102 Class Forum
- 258 LFD103 Class Forum
- LFD103-JP クラス フォーラム
- 27 LFD110 Class Forum
- 50 LFD121 Class Forum
- 3 LFD123 Class Forum
- 1 LFD125 Class Forum
- 19 LFD133 Class Forum
- 10 LFD134 Class Forum
- 19 LFD137 Class Forum
- 1 LFD140 Class Forum
- 73 LFD201 Class Forum
- 8 LFD210 Class Forum
- 6 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- LFD221 Class Forum
- 128 LFD232 Class Forum - Discontinued
- 3 LFD233 Class Forum - Discontinued
- 5 LFD237 Class Forum
- 25 LFD254 Class Forum
- 750 LFD259 Class Forum
- 111 LFD272 Class Forum - Discontinued
- 4 LFD272-JP クラス フォーラム - Discontinued
- 16 LFD273 Class Forum
- 475 LFS101 Class Forum
- 4 LFS111 Class Forum
- 4 LFS112 Class Forum
- 5 LFS116 Class Forum
- 9 LFS118 Class Forum
- 2 LFS120 Class Forum
- LFS140 Class Forum
- 12 LFS142 Class Forum
- 9 LFS144 Class Forum
- 6 LFS145 Class Forum
- 6 LFS146 Class Forum
- 7 LFS147 Class Forum
- 21 LFS148 Class Forum
- 17 LFS151 Class Forum
- 6 LFS157 Class Forum
- 91 LFS158 Class Forum
- 1 LFS158-JP クラス フォーラム
- 14 LFS162 Class Forum
- 2 LFS166 Class Forum - Discontinued
- 9 LFS167 Class Forum
- 5 LFS170 Class Forum
- 2 LFS171 Class Forum - Discontinued
- 4 LFS178 Class Forum - Discontinued
- 4 LFS180 Class Forum
- 3 LFS182 Class Forum
- 7 LFS183 Class Forum
- 2 LFS184 Class Forum
- 41 LFS200 Class Forum
- 737 LFS201 Class Forum - Discontinued
- 3 LFS201-JP クラス フォーラム - Discontinued
- 23 LFS203 Class Forum
- 141 LFS207 Class Forum
- 3 LFS207-DE-Klassenforum
- 3 LFS207-JP クラス フォーラム
- 302 LFS211 Class Forum - Discontinued
- 56 LFS216 Class Forum - Discontinued
- 60 LFS241 Class Forum
- 51 LFS242 Class Forum
- 39 LFS243 Class Forum
- 17 LFS244 Class Forum
- 8 LFS245 Class Forum
- 1 LFS246 Class Forum
- 1 LFS248 Class Forum
- 124 LFS250 Class Forum
- 3 LFS250-JP クラス フォーラム
- 2 LFS251 Class Forum - Discontinued
- 163 LFS253 Class Forum
- 1 LFS254 Class Forum - Discontinued
- 3 LFS255 Class Forum
- 15 LFS256 Class Forum
- 2 LFS257 Class Forum
- 1.4K LFS258 Class Forum
- 12 LFS258-JP クラス フォーラム
- 142 LFS260 Class Forum
- 165 LFS261 Class Forum
- 45 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 25 LFS267 Class Forum
- 27 LFS268 Class Forum
- 38 LFS269 Class Forum
- 11 LFS270 Class Forum
- 202 LFS272 Class Forum - Discontinued
- 2 LFS272-JP クラス フォーラム - Discontinued
- 2 LFS274 Class Forum - Discontinued
- 4 LFS281 Class Forum - Discontinued
- 30 LFW111 Class Forum
- 265 LFW211 Class Forum
- 190 LFW212 Class Forum
- 17 SKF100 Class Forum
- 2 SKF200 Class Forum
- 3 SKF201 Class Forum
- 800 Hardware
- 200 Drivers
- 68 I/O Devices
- 37 Monitors
- 104 Multimedia
- 175 Networking
- 92 Printers & Scanners
- 85 Storage
- 765 Linux Distributions
- 82 Debian
- 67 Fedora
- 20 Linux Mint
- 13 Mageia
- 23 openSUSE
- 149 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 472 Linux System Administration
- 39 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 96 Linux Security
- 78 Network Management
- 102 System Management
- 48 Web Management
- 74 Mobile Computing
- 19 Android
- 42 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 388 Off Topic
- 121 Introductions
- 178 Small Talk
- 28 Study Material
- 879 Programming and Development
- 312 Kernel Development
- 549 Software Development
- 1.8K Software
- 270 Applications
- 183 Command Line
- 5 Compiling/Installing
- 988 Games
- 320 Installation
- 109 All In Program
- 109 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)