Properly restarting nodes
Hi,
I'm doing my labs using two VirtualBox Ubuntu Servers on local.
It works as expected, but if I have to stop the training and shut down nodes, I cannot figure out how to properly restart them.
I think it would be great to include this part on the training.
I try to do like this:
sudo swapoff -a
sudo kubeadm reset
sudo kubeadm init --kubernetes-version 1.16.1 --pod-network-cidr 192.168.0.0/16
and then, as stated in last command output:
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config
But in the best scenario I get new credentials so I am not able to relink the worker node...
Could somebody please provide a straight process for this?
Thank you and keep rocking !
David
Best Answer
-
Hi David / @dcarrascal75,
Any reason why you chose to run a master
resetand aninitafter restart?The behavior you observe is expected when running a
resetandiniton master. In doing so, you wipe clean the configuration of the master and create new credentials for the cluster. Hence, the old worker is not able to join the cluster. An easy fix would be aresetand ajoinon the worker with the new token and hash values produced by the latest init of the master.But why run
resetat all? Assuming your nodes keep their IP addresses, and you permanently disabled swap on your nodes, a simple start of each node should bring up the k8s cluster as well.Regards,
-Chris5
Answers
-
Hi @chrispokorni ,
Thank you for your response

Problem here is that if I shut down my master machine, when I restart it, the cluster is down. If I restart and executekubectl get nodes
I get an error (Unable to connect to the server) because kubernetes is down.
My question is, at this point, how to restart it?
I expected the server to restart on boot, but it is not doing it (unless I've missed some instruction when installing it)Thanks again,
David
0 -
Hi David / @dcarrascal75,
Since you are on VirtualBox, there may be a conflict between the node IP subnet and the Pod IP subnet. Calico uses 192.168.0.0/16 by default, and VBox uses a similar subnet. In such situations, issues may be encountered when rebooting nodes.
Also, if your master node does not retain the same IP address after reboot, then your
kubectlis not able to talk to the master (based on kubeconfig) and the worker cannot find the master either.Regards,
-Chris1 -
Hi @chrispokorni , @serewicz,
I've finally found the issue thanks to journalctl -u kubelet command.
There was not a problem with IP, but is definitely something to keep in mind when working with VMs.Problem was between the keyboard and the chair, as usual

I cloned my last master VM from an image where I have not still done the swapoff, so the kubelet is not able to start.Thank you for your great help and support.
Amazing!Greetings from Spain,
David
0
Categories
- All Categories
- 177 LFX Mentorship
- 177 LFX Mentorship: Linux Kernel
- 750 Linux Foundation IT Professional Programs
- 373 Cloud Engineer IT Professional Program
- 169 Advanced Cloud Engineer IT Professional Program
- 74 DevOps IT Professional Program - Discontinued
- 4 DevOps & GitOps IT Professional Program
- 99 Cloud Native Developer IT Professional Program
- 7.6K Training Courses & Learning Paths
- 1 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 4 Cloud & Containers Training
- 1 Cybersecurity Training
- 2 DevOps & Site-Reliability Training
- 1 Linux Kernel Development Training
- 1 Networking Training
- 2 Open Source Best Practice Training
- 1 System Administration Training
- 1 System Engineering Training
- 1 Web & Application Development Training
- 792 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 95 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 87 Storage
- 769 Linux Distributions
- 81 Debian
- 68 Fedora
- 22 Linux Mint
- 13 Mageia
- 24 openSUSE
- 150 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 465 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 98 Linux Security
- 78 Network Management
- 101 System Management
- 46 Web Management
- 106 Mobile Computing
- 18 Android
- 73 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 392 Off Topic
- 121 Introductions
- 181 Small Talk
- 29 Study Material
- 955 Programming and Development
- 310 Kernel Development
- 627 Software Development
- 984 Software
- 376 Applications
- 182 Command Line
- 5 Compiling/Installing
- 68 Games
- 317 Installation
- Archived
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)