Lab 5.3 with fluentd is too confusing?

Hello,
While doing lab 5.3 I was disappointed to see how I found it confusing.
As a beginner it took me some time to understand the objective.
I think I saw several mistakes and I would propose following modifications:
FLUENT_CONF env var is not working
Better to use
command: ["fluentd"] args: ["-c", "/etc/fluentd-config/fluentd.conf"]
We can see even coursebook is wrong
In the sample given in step 15
, the config file path is incorrect!!
student@ckad-1:~$ kubectl logs basicpod fdlogger 2019-03-06 18:55:33 +0000 [info]: parsing config file is succeeded path="/fluentd/etc/fluent.conf"
They should read the ConfigMap content at /etc/fluentd-config/fluentd.conf
and not default config at /fluentd/etc/fluent.conf
ConfigMap is incorrect
- Mountpoint given in step 11 is incorrect should be /var/log/access.log instead of /var/log/nginx/access.log
- The
@type forward
type is not relevant and leads to error, use@type stdout
instead?
echo ' apiVersion: v1 kind: ConfigMap metadata: name: fluentd-config data: fluentd.conf: | <source> @type tail format none path /var/log/access.log # <- we were pointing to wrong mount point /var/log/nginx/access.log in step 11 tag count.format1 </source> <match *.**> # <- we were doing a forward to server which shows nothing @type stdout </match> ' > weblog-configmap.yaml
I propose following modif from step 5.3.11 (I use deployment but pod is fine)
echo ' apiVersion: v1 kind: ConfigMap metadata: name: fluentd-config data: fluentd.conf: | <source> @type tail format none path /var/log/access.log tag count.format1 </source> <match *.**> @type stdout </match> ' > weblog-configmap.yaml k create -f weblog-configmap.yaml
And modify deployment as follows
echo ' apiVersion: apps/v1 kind: Deployment metadata: creationTimestamp: null labels: app: basic name: basic spec: replicas: 1 selector: matchLabels: app: basic strategy: {} template: metadata: creationTimestamp: null labels: app: basic spec: volumes: - name: weblog-pv-storage persistentVolumeClaim: claimName: weblog-pv-claim - name: log-config configMap: name: fluentd-config containers: - image: nginx name: nginx ports: - containerPort: 80 volumeMounts: - mountPath: "/var/log/nginx" name: weblog-pv-storage - image: fluent/fluentd command: ["fluentd"] args: ["-c", "/etc/fluentd-config/fluentd.conf", "--verbose"] name: fdlogger volumeMounts: - mountPath: "/var/log" name: weblog-pv-storage - mountPath: "/etc/fluentd-config" name: log-config ' > basic3.yaml k create -f basic3.yaml
Then we can tail the logs
export POD_NAME=$(k get pods -o wide | grep "basic-" | awk '{ print $1 }') k logs -f $POD_NAME fdlogger vagrant@k8sMaster:~$ k logs $POD_NAME fdlogger | grep access path "/var/log/access.log" 2020-02-13 19:08:22 +0000 [info]: #0 following tail of /var/log/access.log
Then in a separate window do:
export POD_IP=$(k get pods -o wide | grep "basic-" | awk '{ print $6 }') echo $POD_IP watch -n1 curl $POD_IP
And it appears in first window:
2020-02-13 19:56:12.855010348 +0000 count.format1: {"message":"10.0.2.15 - - [13/Feb/2020:19:56:12 +0000] \"GET / HTTP/1.1\" 200 612 \"-\" \"curl/7.58.0\" \"-\""} 2020-02-13 19:56:13.856553408 +0000 count.format1: {"message":"10.0.2.15 - - [13/Feb/2020:19:56:13 +0000] \"GET / HTTP/1.1\" 200 612 \"-\" \"curl/7.58.0\" \"-\""}
Am I wrong, did I miss something? What do you think?
Thanks for the help,
Cheers,
Sylvain
Comments
-
Hello,
Thank you for the feedback. We'll investigate the matter and update the material as necessary.
Thank you,
0
Categories
- All Categories
- 49 LFX Mentorship
- 102 LFX Mentorship: Linux Kernel
- 550 Linux Foundation Boot Camps
- 294 Cloud Engineer Boot Camp
- 118 Advanced Cloud Engineer Boot Camp
- 52 DevOps Engineer Boot Camp
- 53 Cloud Native Developer Boot Camp
- 4 Express Training Courses
- 4 Express Courses - Discussion Forum
- 1.9K Training Courses
- 18 LFC110 Class Forum
- 6 LFC131 Class Forum
- 24 LFD102 Class Forum
- 150 LFD103 Class Forum
- 17 LFD121 Class Forum
- 61 LFD201 Class Forum
- LFD210 Class Forum
- LFD210-CN Class Forum
- 1 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum
- LFD237 Class Forum
- 23 LFD254 Class Forum
- 596 LFD259 Class Forum
- 102 LFD272 Class Forum
- 1 LFD272-JP クラス フォーラム
- LFD273 Class Forum
- 2 LFS145 Class Forum
- 24 LFS200 Class Forum
- 739 LFS201 Class Forum
- 1 LFS201-JP クラス フォーラム
- 3 LFS203 Class Forum
- 69 LFS207 Class Forum
- 300 LFS211 Class Forum
- 54 LFS216 Class Forum
- 47 LFS241 Class Forum
- 41 LFS242 Class Forum
- 37 LFS243 Class Forum
- 11 LFS244 Class Forum
- 33 LFS250 Class Forum
- 1 LFS250-JP クラス フォーラム
- LFS251 Class Forum
- 139 LFS253 Class Forum
- 1K LFS258 Class Forum
- 10 LFS258-JP クラス フォーラム
- 92 LFS260 Class Forum
- 129 LFS261 Class Forum
- 32 LFS262 Class Forum
- 79 LFS263 Class Forum
- 15 LFS264 Class Forum
- 11 LFS266 Class Forum
- 17 LFS267 Class Forum
- 17 LFS268 Class Forum
- 23 LFS269 Class Forum
- 203 LFS272 Class Forum
- 1 LFS272-JP クラス フォーラム
- LFS281 Class Forum
- 220 LFW211 Class Forum
- 166 LFW212 Class Forum
- SKF100 Class Forum
- 901 Hardware
- 219 Drivers
- 74 I/O Devices
- 44 Monitors
- 115 Multimedia
- 208 Networking
- 101 Printers & Scanners
- 85 Storage
- 761 Linux Distributions
- 88 Debian
- 66 Fedora
- 15 Linux Mint
- 13 Mageia
- 24 openSUSE
- 141 Red Hat Enterprise
- 33 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 476 Linux System Administration
- 41 Cloud Computing
- 69 Command Line/Scripting
- Github systems admin projects
- 94 Linux Security
- 77 Network Management
- 108 System Management
- 49 Web Management
- 66 Mobile Computing
- 23 Android
- 29 Development
- 1.2K New to Linux
- 1.1K Getting Started with Linux
- 536 Off Topic
- 131 Introductions
- 216 Small Talk
- 21 Study Material
- 816 Programming and Development
- 275 Kernel Development
- 507 Software Development
- 927 Software
- 260 Applications
- 183 Command Line
- 3 Compiling/Installing
- 76 Games
- 316 Installation
- 59 All In Program
- 59 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)