Lab 5.3 with fluentd is too confusing?

Hello,
While doing lab 5.3 I was disappointed to see how I found it confusing.
As a beginner it took me some time to understand the objective.
I think I saw several mistakes and I would propose following modifications:
FLUENT_CONF env var is not working
Better to use
- command: ["fluentd"]
- args: ["-c", "/etc/fluentd-config/fluentd.conf"]
We can see even coursebook is wrong
In the sample given in step 15
, the config file path is incorrect!!
- student@ckad-1:~$ kubectl logs basicpod fdlogger
- 2019-03-06 18:55:33 +0000 [info]: parsing config file is succeeded path="/fluentd/etc/fluent.conf"
They should read the ConfigMap content at /etc/fluentd-config/fluentd.conf
and not default config at /fluentd/etc/fluent.conf
ConfigMap is incorrect
- Mountpoint given in step 11 is incorrect should be /var/log/access.log instead of /var/log/nginx/access.log
- The
@type forward
type is not relevant and leads to error, use@type stdout
instead?
- echo '
- apiVersion: v1
- kind: ConfigMap
- metadata:
- name: fluentd-config
- data:
- fluentd.conf: |
- <source>
- @type tail
- format none
- path /var/log/access.log # <- we were pointing to wrong mount point /var/log/nginx/access.log in step 11
- tag count.format1
- </source>
- <match *.**> # <- we were doing a forward to server which shows nothing
- @type stdout
- </match>
- ' > weblog-configmap.yaml
I propose following modif from step 5.3.11 (I use deployment but pod is fine)
- echo '
- apiVersion: v1
- kind: ConfigMap
- metadata:
- name: fluentd-config
- data:
- fluentd.conf: |
- <source>
- @type tail
- format none
- path /var/log/access.log
- tag count.format1
- </source>
- <match *.**>
- @type stdout
- </match>
- ' > weblog-configmap.yaml
- k create -f weblog-configmap.yaml
And modify deployment as follows
- echo '
- apiVersion: apps/v1
- kind: Deployment
- metadata:
- creationTimestamp: null
- labels:
- app: basic
- name: basic
- spec:
- replicas: 1
- selector:
- matchLabels:
- app: basic
- strategy: {}
- template:
- metadata:
- creationTimestamp: null
- labels:
- app: basic
- spec:
- volumes:
- - name: weblog-pv-storage
- persistentVolumeClaim:
- claimName: weblog-pv-claim
- - name: log-config
- configMap:
- name: fluentd-config
- containers:
- - image: nginx
- name: nginx
- ports:
- - containerPort: 80
- volumeMounts:
- - mountPath: "/var/log/nginx"
- name: weblog-pv-storage
- - image: fluent/fluentd
- command: ["fluentd"]
- args: ["-c", "/etc/fluentd-config/fluentd.conf", "--verbose"]
- name: fdlogger
- volumeMounts:
- - mountPath: "/var/log"
- name: weblog-pv-storage
- - mountPath: "/etc/fluentd-config"
- name: log-config
- ' > basic3.yaml
- k create -f basic3.yaml
Then we can tail the logs
- export POD_NAME=$(k get pods -o wide | grep "basic-" | awk '{ print $1 }')
- k logs -f $POD_NAME fdlogger
- vagrant@k8sMaster:~$ k logs $POD_NAME fdlogger | grep access
- path "/var/log/access.log"
- 2020-02-13 19:08:22 +0000 [info]: #0 following tail of /var/log/access.log
Then in a separate window do:
- export POD_IP=$(k get pods -o wide | grep "basic-" | awk '{ print $6 }')
- echo $POD_IP
- watch -n1 curl $POD_IP
And it appears in first window:
- 2020-02-13 19:56:12.855010348 +0000 count.format1: {"message":"10.0.2.15 - - [13/Feb/2020:19:56:12 +0000] \"GET / HTTP/1.1\" 200 612 \"-\" \"curl/7.58.0\" \"-\""}
- 2020-02-13 19:56:13.856553408 +0000 count.format1: {"message":"10.0.2.15 - - [13/Feb/2020:19:56:13 +0000] \"GET / HTTP/1.1\" 200 612 \"-\" \"curl/7.58.0\" \"-\""}
Am I wrong, did I miss something? What do you think?
Thanks for the help,
Cheers,
Sylvain
Comments
-
Hello,
Thank you for the feedback. We'll investigate the matter and update the material as necessary.
Thank you,
0
Categories
- All Categories
- 139 LFX Mentorship
- 139 LFX Mentorship: Linux Kernel
- 815 Linux Foundation IT Professional Programs
- 366 Cloud Engineer IT Professional Program
- 184 Advanced Cloud Engineer IT Professional Program
- 83 DevOps Engineer IT Professional Program
- 151 Cloud Native Developer IT Professional Program
- 142 Express Training Courses & Microlearning
- 142 Express Courses - Discussion Forum
- Microlearning - Discussion Forum
- 6.6K Training Courses
- 48 LFC110 Class Forum - Discontinued
- 72 LFC131 Class Forum
- 49 LFD102 Class Forum
- 234 LFD103 Class Forum
- 21 LFD110 Class Forum
- 44 LFD121 Class Forum
- LFD123 Class Forum
- LFD125 Class Forum
- 18 LFD133 Class Forum
- 8 LFD134 Class Forum
- 18 LFD137 Class Forum
- 72 LFD201 Class Forum
- 5 LFD210 Class Forum
- 5 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum - Discontinued
- 2 LFD233 Class Forum
- 4 LFD237 Class Forum
- 24 LFD254 Class Forum
- 719 LFD259 Class Forum
- 111 LFD272 Class Forum - Discontinued
- 4 LFD272-JP クラス フォーラム
- 13 LFD273 Class Forum
- 242 LFS101 Class Forum
- 2 LFS111 Class Forum
- 3 LFS112 Class Forum
- 3 LFS116 Class Forum
- 7 LFS118 Class Forum
- LFS120 Class Forum
- 9 LFS142 Class Forum
- 8 LFS144 Class Forum
- 4 LFS145 Class Forum
- 4 LFS146 Class Forum
- 16 LFS148 Class Forum
- 15 LFS151 Class Forum
- 5 LFS157 Class Forum
- 66 LFS158 Class Forum
- LFS158-JP クラス フォーラム
- 11 LFS162 Class Forum
- 2 LFS166 Class Forum
- 7 LFS167 Class Forum
- 3 LFS170 Class Forum
- 2 LFS171 Class Forum
- 3 LFS178 Class Forum
- 3 LFS180 Class Forum
- 2 LFS182 Class Forum
- 5 LFS183 Class Forum
- 33 LFS200 Class Forum
- 737 LFS201 Class Forum - Discontinued
- 3 LFS201-JP クラス フォーラム - Discontinued
- 20 LFS203 Class Forum
- 135 LFS207 Class Forum
- 2 LFS207-DE-Klassenforum
- 2 LFS207-JP クラス フォーラム
- 302 LFS211 Class Forum
- 56 LFS216 Class Forum
- 53 LFS241 Class Forum
- 50 LFS242 Class Forum
- 38 LFS243 Class Forum
- 16 LFS244 Class Forum
- 5 LFS245 Class Forum
- LFS246 Class Forum
- LFS248 Class Forum
- 88 LFS250 Class Forum
- 2 LFS250-JP クラス フォーラム
- 1 LFS251 Class Forum
- 156 LFS253 Class Forum
- 1 LFS254 Class Forum
- 2 LFS255 Class Forum
- 12 LFS256 Class Forum
- 1 LFS257 Class Forum
- 1.3K LFS258 Class Forum
- 11 LFS258-JP クラス フォーラム
- 135 LFS260 Class Forum
- 162 LFS261 Class Forum
- 43 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 24 LFS267 Class Forum
- 25 LFS268 Class Forum
- 37 LFS269 Class Forum
- 7 LFS270 Class Forum
- 202 LFS272 Class Forum - Discontinued
- 2 LFS272-JP クラス フォーラム
- 4 LFS147 Class Forum
- 2 LFS274 Class Forum
- 4 LFS281 Class Forum
- 16 LFW111 Class Forum
- 262 LFW211 Class Forum
- 185 LFW212 Class Forum
- 15 SKF100 Class Forum
- 1 SKF200 Class Forum
- 2 SKF201 Class Forum
- 797 Hardware
- 199 Drivers
- 68 I/O Devices
- 37 Monitors
- 104 Multimedia
- 174 Networking
- 91 Printers & Scanners
- 85 Storage
- 761 Linux Distributions
- 82 Debian
- 67 Fedora
- 17 Linux Mint
- 13 Mageia
- 23 openSUSE
- 149 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 355 Ubuntu
- 470 Linux System Administration
- 39 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 95 Linux Security
- 78 Network Management
- 102 System Management
- 47 Web Management
- 69 Mobile Computing
- 18 Android
- 38 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 379 Off Topic
- 115 Introductions
- 177 Small Talk
- 26 Study Material
- 808 Programming and Development
- 304 Kernel Development
- 486 Software Development
- 1.8K Software
- 263 Applications
- 183 Command Line
- 3 Compiling/Installing
- 988 Games
- 317 Installation
- 103 All In Program
- 103 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)