kubernetes installed by kind can't pull container images
I've installed k8s with kind using the instructions from the course. When I started with the first lab with consul, I found that my kubelet running inside consul-control-plane container fails to pull images of the emojivoto applications:
vagrant@k8s:~/lab3.2$ kubectl get po -n emojivoto NAME READY STATUS RESTARTS AGE emoji-65df4d68f7-9nhqf 0/1 ImagePullBackOff 0 19m vote-bot-7c59767698-dk5pc 0/1 ImagePullBackOff 0 29m voting-768f496cd8-8xlrd 0/1 ErrImagePull 0 29m web-545f869fc4-6z5g8 0/1 ImagePullBackOff 0 29m
in order to exclude any problems with name resolving I've changed nameserver in /etc/resolve.cof to google dns and I can see that name resolution works from within the consul-control-plane container.
vagrant@k8s:~/lab3.2$ docker exec -it consul-control-plane bash root@consul-control-plane:/# cat /etc/resolv.conf nameserver 8.8.8.8 root@consul-control-plane:/# curl -v google.com * Trying 172.217.23.142:80... * TCP_NODELAY set * Connected to google.com (172.217.23.142) port 80 (#0) GET / HTTP/1.1
But at the same time in journal for kubelet that is running inside that container I still see that it fails to pull the image
root@consul-control-plane:/# journalctl -fu kubelet.service -- Logs begin at Tue 2021-01-26 20:44:41 UTC. -- Jan 26 21:24:51 consul-control-plane kubelet[4620]: E0126 21:24:51.745867 4620 pod_workers.go:191] Error syncing pod 5896010f-a7b1-41d4-92ff-4460b862a146 ("voting-768f496cd8-8xlrd_emojivoto(5896010f-a7b1-41d4-92ff-4460b862a146)"), skipping: failed to "StartContainer" for "voting-svc" with ImagePullBackOff: "Back-off pulling image \"docker.l5d.io/buoyantio/emojivoto-voting-svc:v11\"" Jan 26 21:24:53 consul-control-plane kubelet[4620]: E0126 21:24:53.745825 4620 pod_workers.go:191] Error syncing pod 40b8f63d-c56c-4916-a07a-5c6ef05f3b1c ("vote-bot-7c59767698-dk5pc_emojivoto(40b8f63d-c56c-4916-a07a-5c6ef05f3b1c)"), skipping: failed to "StartContainer" for "vote-bot" with ImagePullBackOff: "Back-off pulling image \"docker.l5d.io/buoyantio/emojivoto-web:v11\"" Jan 26 21:25:01 consul-control-plane kubelet[4620]: E0126 21:25:01.746200 4620 pod_workers.go:191] Error syncing pod 053f9fe8-ab56-4653-a23d-1584c4a1a0f0 ("web-545f869fc4-6z5g8_emojivoto(053f9fe8-ab56-4653-a23d-1584c4a1a0f0)"), skipping: failed to "StartContainer" for "web-svc" with ImagePullBackOff: "Back-off pulling image \"docker.l5d.io/buoyantio/emojivoto-web:v11\""
I tried to restart it, but it didn't help. Any ideas how I can troubleshoot this further?
Comments
-
One addition. When I changed registry from docker.l5d.io to just docker hub (default one) it worked:
vagrant@k8s:~/lab3.2$ kubectl get po -n emojivoto NAME READY STATUS RESTARTS AGE emoji-5fcc588b77-m7kdd 1/1 Running 0 44s vote-bot-658cb85b6-xj4zz 1/1 Running 0 44s voting-5858f494d-cx2dp 1/1 Running 0 44s web-7ddc6b67d6-zcxps 1/1 Running 0 43s
0
Categories
- All Categories
- 167 LFX Mentorship
- 219 LFX Mentorship: Linux Kernel
- 801 Linux Foundation IT Professional Programs
- 358 Cloud Engineer IT Professional Program
- 180 Advanced Cloud Engineer IT Professional Program
- 83 DevOps Engineer IT Professional Program
- 149 Cloud Native Developer IT Professional Program
- 112 Express Training Courses
- 138 Express Courses - Discussion Forum
- 6.2K Training Courses
- 48 LFC110 Class Forum - Discontinued
- 17 LFC131 Class Forum
- 42 LFD102 Class Forum
- 227 LFD103 Class Forum
- 19 LFD110 Class Forum
- 39 LFD121 Class Forum
- 15 LFD133 Class Forum
- 7 LFD134 Class Forum
- 17 LFD137 Class Forum
- 63 LFD201 Class Forum
- 3 LFD210 Class Forum
- 5 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum - Discontinued
- 1 LFD233 Class Forum
- 2 LFD237 Class Forum
- 23 LFD254 Class Forum
- 697 LFD259 Class Forum
- 109 LFD272 Class Forum
- 3 LFD272-JP クラス フォーラム
- 10 LFD273 Class Forum
- 154 LFS101 Class Forum
- 1 LFS111 Class Forum
- 1 LFS112 Class Forum
- 1 LFS116 Class Forum
- 1 LFS118 Class Forum
- LFS120 Class Forum
- 7 LFS142 Class Forum
- 7 LFS144 Class Forum
- 3 LFS145 Class Forum
- 1 LFS146 Class Forum
- 3 LFS147 Class Forum
- 1 LFS148 Class Forum
- 15 LFS151 Class Forum
- 1 LFS157 Class Forum
- 34 LFS158 Class Forum
- 8 LFS162 Class Forum
- 1 LFS166 Class Forum
- 1 LFS167 Class Forum
- 3 LFS170 Class Forum
- 2 LFS171 Class Forum
- 1 LFS178 Class Forum
- 1 LFS180 Class Forum
- 1 LFS182 Class Forum
- 1 LFS183 Class Forum
- 29 LFS200 Class Forum
- 736 LFS201 Class Forum - Discontinued
- 2 LFS201-JP クラス フォーラム
- 14 LFS203 Class Forum
- 135 LFS207 Class Forum
- 1 LFS207-DE-Klassenforum
- 1 LFS207-JP クラス フォーラム
- 301 LFS211 Class Forum
- 55 LFS216 Class Forum
- 48 LFS241 Class Forum
- 48 LFS242 Class Forum
- 37 LFS243 Class Forum
- 15 LFS244 Class Forum
- LFS245 Class Forum
- LFS246 Class Forum
- 50 LFS250 Class Forum
- 1 LFS250-JP クラス フォーラム
- LFS251 Class Forum
- 155 LFS253 Class Forum
- LFS254 Class Forum
- LFS255 Class Forum
- 5 LFS256 Class Forum
- 1 LFS257 Class Forum
- 1.3K LFS258 Class Forum
- 10 LFS258-JP クラス フォーラム
- 122 LFS260 Class Forum
- 159 LFS261 Class Forum
- 42 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 20 LFS267 Class Forum
- 25 LFS268 Class Forum
- 31 LFS269 Class Forum
- 3 LFS270 Class Forum
- 199 LFS272 Class Forum
- 1 LFS272-JP クラス フォーラム
- LFS274 Class Forum
- 3 LFS281 Class Forum
- 10 LFW111 Class Forum
- 261 LFW211 Class Forum
- 182 LFW212 Class Forum
- 15 SKF100 Class Forum
- 1 SKF200 Class Forum
- 1 SKF201 Class Forum
- 782 Hardware
- 198 Drivers
- 68 I/O Devices
- 37 Monitors
- 96 Multimedia
- 174 Networking
- 91 Printers & Scanners
- 83 Storage
- 758 Linux Distributions
- 80 Debian
- 67 Fedora
- 15 Linux Mint
- 13 Mageia
- 23 openSUSE
- 143 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 348 Ubuntu
- 461 Linux System Administration
- 39 Cloud Computing
- 70 Command Line/Scripting
- Github systems admin projects
- 90 Linux Security
- 77 Network Management
- 101 System Management
- 46 Web Management
- 64 Mobile Computing
- 17 Android
- 34 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 371 Off Topic
- 114 Introductions
- 174 Small Talk
- 19 Study Material
- 806 Programming and Development
- 304 Kernel Development
- 204 Software Development
- 1.8K Software
- 263 Applications
- 180 Command Line
- 3 Compiling/Installing
- 405 Games
- 309 Installation
- 97 All In Program
- 97 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)