Lab 3.1 is brittle, kubeadm command on master needs to specify Kubernetes server version

kubeadm downloads, by default, the latest version of the Kubernetes core services from gcr.io. On the other hand, the lab instructions call out a specific version of kubeadm, kubectl, and kubelet. So if a student tries to follow the lab instructions at a time when, say, the newest version of Kubernetes is 1.13 but the course instructions call for 1.12.1, the result will be a version skew. This skew won't cause a problem until the student attempts to add a node. Then this error message will result in the kubeadm join command:
[kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.12" ConfigMap in the kube-system namespace configmaps "kubelet-config-1.12" is forbidden: User "system:bootstrap:3ai26q" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
To avoid this problem, the lab instructions should also explicitly name the desired version of Kubernetes in the master's kubeadm command:
kubeadm init --kubernetes-version 1.12.1 --pod-network-cidr
whatever/whatever
Comments
-
Hello,
When v1.13 was released last Monday there was a newer version of the software available than what we installed, v1.12. It seems that the kubeadm init command has an "undocumented/not-well-documented feature" where the control plane will pull the newer version. The 1.13 plane does not let the join take place. The fix is to tell the init what version to use with this update, which I will add to the course shortly, is this:kubeadm init --kubernetes-version 1.12.1 --pod-network-cidr 192.168.0.0/16
Once all the version match, it should work as otherwise described in the book.
Kind regards,
0 -
When I run the kubeadm command following the lab instructions, I get the following error regardless of whether I specify the kubernetes version:
[ERROR KubeletVersion]: Kubelet version "1.11.5-gke.5" is lower than kubadm can support. Please upgrade kubelet
I'm running the latest Kubelet version available on GKE, so I'm not sure how else I can upgrade kubelet. Downgrading kubeadm didn't help either. What is a setup that would work?
0 -
Hi @tanjiehui ,
The instructions in the labs are for the vendor-neutral Kubernetes with installation and cluster management tools - such as kubeadm and kubectl. The labs have been completed and tested on GCE VMs, with Ubuntu 16, and Kubernetes 1.12.1. By using GCE VMs we control most aspects of the environment. With GKE however, we would be tied in with Google's offering, including their software versions and cluster configuration.
The labs would also work on AWS EC2 instances, Azure VMs, VirtualBox or VMware VMs.
Regards,
-Chris1 -
Hi,
I am facing similar issues... providing details...
firewall rules & instance types
firewall rules on worker
pods
Any suggestions on where i might have gone astray ...
Thank you,
0 -
Hi @Sand1987,
Thanks for providing a detailed output.
In earlier posts, we made some suggestions about the networking setup to be able to successfully complete the lab exercises. The default VPC caused issues while running some of the lab exercises, so we suggested a custom VPC network with an all open firewall rule: all ports, all protocols, all sources/destinations. With several restrictive firewall rules based on protocols and port ranges from the documentation (which may be incomplete), chances are that some ports will be missed and traffic will end up being blocked.
Also instance sizes matter: at least 2 vCPUs and about 8 GB memory. Smaller instance types have cause issues in the past - as Kubernetes software continues to grow in size.
Regards,
-Chris0 -
Thanks Chris...
Will test again... been playing around with kubernetes-the-hard-way ... got some ideas from there :-)
0 -
Hi, I am getting kubeadm failing due to docker version. should we downgrade it ?
Thanks
i have also downgraded kubectl kubeadm and kubelet versions as per lab
sudo apt install kubelet=1.11.3-00 kubeadm=1.11.3-00 kubectl=1.11.3-00 -y --allow-downgrades
please guide.
Thanks
0 -
Hi @KashifAhsan, what you see in your output above is only a warning, but the latest version of Docker works just fine - there is no need to downgrade.
However, it seems your Kubernetes versions are off. The screenshot shows 1.13.4, and your notes below the screenshot show 1.11.3.
None of these versions have been tested successfully with these lab exercises on Ubuntu 16.04 LTS.
When specific versions are provided in the exercises, please follow those for consistency.
The latest version of the lab exercises manual calls for Kubernetes version 1.13.1.
Regards,
-Chris0
Categories
- All Categories
- 50 LFX Mentorship
- 103 LFX Mentorship: Linux Kernel
- 575 Linux Foundation IT Professional Programs
- 304 Cloud Engineer IT Professional Program
- 125 Advanced Cloud Engineer IT Professional Program
- 53 DevOps Engineer IT Professional Program
- 60 Cloud Native Developer IT Professional Program
- 5 Express Training Courses
- 5 Express Courses - Discussion Forum
- 2K Training Courses
- 19 LFC110 Class Forum
- 7 LFC131 Class Forum
- 27 LFD102 Class Forum
- 157 LFD103 Class Forum
- 20 LFD121 Class Forum
- 1 LFD137 Class Forum
- 61 LFD201 Class Forum
- 1 LFD210 Class Forum
- LFD210-CN Class Forum
- 1 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum
- LFD237 Class Forum
- 23 LFD254 Class Forum
- 611 LFD259 Class Forum
- 105 LFD272 Class Forum
- 1 LFD272-JP クラス フォーラム
- 1 LFD273 Class Forum
- 2 LFS145 Class Forum
- 24 LFS200 Class Forum
- 739 LFS201 Class Forum
- 1 LFS201-JP クラス フォーラム
- 11 LFS203 Class Forum
- 75 LFS207 Class Forum
- 300 LFS211 Class Forum
- 54 LFS216 Class Forum
- 47 LFS241 Class Forum
- 41 LFS242 Class Forum
- 37 LFS243 Class Forum
- 11 LFS244 Class Forum
- 36 LFS250 Class Forum
- 1 LFS250-JP クラス フォーラム
- LFS251 Class Forum
- 140 LFS253 Class Forum
- LFS254 Class Forum
- 1.1K LFS258 Class Forum
- 10 LFS258-JP クラス フォーラム
- 93 LFS260 Class Forum
- 132 LFS261 Class Forum
- 33 LFS262 Class Forum
- 80 LFS263 Class Forum
- 15 LFS264 Class Forum
- 11 LFS266 Class Forum
- 18 LFS267 Class Forum
- 17 LFS268 Class Forum
- 23 LFS269 Class Forum
- 203 LFS272 Class Forum
- 1 LFS272-JP クラス フォーラム
- LFS274 Class Forum
- LFS281 Class Forum
- 233 LFW211 Class Forum
- 172 LFW212 Class Forum
- 7 SKF100 Class Forum
- SKF200 Class Forum
- 902 Hardware
- 219 Drivers
- 74 I/O Devices
- 44 Monitors
- 115 Multimedia
- 209 Networking
- 101 Printers & Scanners
- 85 Storage
- 763 Linux Distributions
- 88 Debian
- 66 Fedora
- 15 Linux Mint
- 13 Mageia
- 24 openSUSE
- 142 Red Hat Enterprise
- 33 Slackware
- 13 SUSE Enterprise
- 357 Ubuntu
- 479 Linux System Administration
- 41 Cloud Computing
- 70 Command Line/Scripting
- Github systems admin projects
- 95 Linux Security
- 78 Network Management
- 108 System Management
- 49 Web Management
- 68 Mobile Computing
- 23 Android
- 30 Development
- 1.2K New to Linux
- 1.1K Getting Started with Linux
- 537 Off Topic
- 131 Introductions
- 217 Small Talk
- 21 Study Material
- 826 Programming and Development
- 278 Kernel Development
- 514 Software Development
- 928 Software
- 260 Applications
- 184 Command Line
- 3 Compiling/Installing
- 76 Games
- 316 Installation
- 62 All In Program
- 62 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)