Welcome to the Linux Foundation Forum!
K8s Crashback loop

chris
Posts: 2
Hi
I am currently going through the Kubernetes Chapter and I am running into an issue with the deployment. The prometheus container keeps going into a crashbackloop.
Normal Pulled 10m (x5 over 11m) kubelet, vagrant Container image "prom/prometheus:v2.1.0" already present on machine Normal Created 10m (x5 over 11m) kubelet, vagrant Created container prometheus Warning BackOff 83s (x49 over 11m) kubelet, vagrant Back-off restarting failed container
It comes and then all the services shutdown
level=info ts=2019-04-25T12:59:17.96088709Z caller=web.go:383 component=web msg="Start listening for connections" address=:9090 level=info ts=2019-04-25T12:59:17.960921987Z caller=main.go:499 msg="Starting TSDB ..." level=info ts=2019-04-25T12:59:17.961378121Z caller=main.go:386 msg="Stopping scrape discovery manager..." level=info ts=2019-04-25T12:59:17.961462142Z caller=main.go:400 msg="Stopping notify discovery manager..." level=info ts=2019-04-25T12:59:17.961534296Z caller=main.go:424 msg="Stopping scrape manager..." level=info ts=2019-04-25T12:59:17.961598612Z caller=manager.go:460 component="rule manager" msg="Stopping rule manager..." level=info ts=2019-04-25T12:59:17.961702813Z caller=manager.go:466 component="rule manager" msg="Rule manager stopped" level=info ts=2019-04-25T12:59:17.961739804Z caller=notifier.go:493 component=notifier msg="Stopping notification manager..." level=info ts=2019-04-25T12:59:17.961767336Z caller=main.go:382 msg="Scrape discovery manager stopped" level=info ts=2019-04-25T12:59:17.961870772Z caller=main.go:396 msg="Notify discovery manager stopped" level=info ts=2019-04-25T12:59:17.961972292Z caller=manager.go:59 component="scrape manager" msg="Starting scrape manager..." level=info ts=2019-04-25T12:59:17.962012646Z caller=main.go:418 msg="Scrape manager stopped" level=info ts=2019-04-25T12:59:17.962037506Z caller=main.go:570 msg="Notifier manager stopped" level=error ts=2019-04-25T12:59:17.96406764Z caller=main.go:579 err="Opening storage failed mkdir data/: permission denied" level=info ts=2019-04-25T12:59:17.964102554Z caller=main.go:581 msg="See you next time!"
Anyone else bump into this issue?
Running K8s 1.14.1, with containerd as my runtime.
0
Comments
-
In case anyone else runs into this issue, I managed to sort it out by applying the following SecurityContext
securityContext: runAsUser: 0
Found the answer here, https://github.com/prometheus/prometheus/issues/2939#issuecomment-315046699
0
Categories
- All Categories
- 158 LFX Mentorship
- 158 LFX Mentorship: Linux Kernel
- 841 Linux Foundation IT Professional Programs
- 384 Cloud Engineer IT Professional Program
- 185 Advanced Cloud Engineer IT Professional Program
- 87 DevOps Engineer IT Professional Program
- 154 Cloud Native Developer IT Professional Program
- 151 Express Training Courses & Microlearning
- 149 Express Courses - Discussion Forum
- 2 Microlearning - Discussion Forum
- 7K Training Courses
- 49 LFC110 Class Forum - Discontinued
- 74 LFC131 Class Forum
- 56 LFD102 Class Forum
- 251 LFD103 Class Forum
- 26 LFD110 Class Forum
- 49 LFD121 Class Forum
- 2 LFD123 Class Forum
- 1 LFD125 Class Forum
- 19 LFD133 Class Forum
- 10 LFD134 Class Forum
- 19 LFD137 Class Forum
- 1 LFD140 Class Forum
- 73 LFD201 Class Forum
- 8 LFD210 Class Forum
- 6 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum - Discontinued
- 3 LFD233 Class Forum
- 5 LFD237 Class Forum
- 25 LFD254 Class Forum
- 735 LFD259 Class Forum
- 111 LFD272 Class Forum - Discontinued
- 4 LFD272-JP クラス フォーラム - Discontinued
- 16 LFD273 Class Forum
- 399 LFS101 Class Forum
- 3 LFS111 Class Forum
- 4 LFS112 Class Forum
- 5 LFS116 Class Forum
- 9 LFS118 Class Forum
- 2 LFS120 Class Forum
- 11 LFS142 Class Forum
- 9 LFS144 Class Forum
- 5 LFS145 Class Forum
- 6 LFS146 Class Forum
- 6 LFS147 Class Forum
- 20 LFS148 Class Forum
- 17 LFS151 Class Forum
- 6 LFS157 Class Forum
- 83 LFS158 Class Forum
- 1 LFS158-JP クラス フォーラム
- 13 LFS162 Class Forum
- 2 LFS166 Class Forum - Discontinued
- 8 LFS167 Class Forum
- 4 LFS170 Class Forum
- 2 LFS171 Class Forum - Discontinued
- 4 LFS178 Class Forum - Discontinued
- 4 LFS180 Class Forum
- 3 LFS182 Class Forum
- 7 LFS183 Class Forum
- 1 LFS184 Class Forum
- 38 LFS200 Class Forum
- 737 LFS201 Class Forum - Discontinued
- 3 LFS201-JP クラス フォーラム - Discontinued
- 22 LFS203 Class Forum
- 141 LFS207 Class Forum
- 3 LFS207-DE-Klassenforum
- 3 LFS207-JP クラス フォーラム
- 302 LFS211 Class Forum - Discontinued
- 56 LFS216 Class Forum - Discontinued
- 60 LFS241 Class Forum
- 51 LFS242 Class Forum
- 39 LFS243 Class Forum
- 17 LFS244 Class Forum
- 8 LFS245 Class Forum
- 1 LFS246 Class Forum
- 1 LFS248 Class Forum
- 120 LFS250 Class Forum
- 3 LFS250-JP クラス フォーラム
- 2 LFS251 Class Forum
- 162 LFS253 Class Forum
- 1 LFS254 Class Forum - Discontinued
- 3 LFS255 Class Forum
- 15 LFS256 Class Forum
- 2 LFS257 Class Forum
- 1.3K LFS258 Class Forum
- 12 LFS258-JP クラス フォーラム
- 139 LFS260 Class Forum
- 165 LFS261 Class Forum
- 44 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 25 LFS267 Class Forum
- 27 LFS268 Class Forum
- 38 LFS269 Class Forum
- 11 LFS270 Class Forum
- 202 LFS272 Class Forum - Discontinued
- 2 LFS272-JP クラス フォーラム - Discontinued
- 2 LFS274 Class Forum - Discontinued
- 4 LFS281 Class Forum - Discontinued
- 30 LFW111 Class Forum
- 263 LFW211 Class Forum
- 187 LFW212 Class Forum
- 16 SKF100 Class Forum
- 2 SKF200 Class Forum
- 3 SKF201 Class Forum
- 800 Hardware
- 200 Drivers
- 68 I/O Devices
- 37 Monitors
- 104 Multimedia
- 175 Networking
- 92 Printers & Scanners
- 85 Storage
- 765 Linux Distributions
- 82 Debian
- 67 Fedora
- 20 Linux Mint
- 13 Mageia
- 23 openSUSE
- 149 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 472 Linux System Administration
- 39 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 96 Linux Security
- 78 Network Management
- 102 System Management
- 48 Web Management
- 72 Mobile Computing
- 19 Android
- 40 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 385 Off Topic
- 118 Introductions
- 178 Small Talk
- 28 Study Material
- 814 Programming and Development
- 307 Kernel Development
- 489 Software Development
- 1.8K Software
- 264 Applications
- 183 Command Line
- 4 Compiling/Installing
- 988 Games
- 317 Installation
- 107 All In Program
- 107 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)