Lab 2.6 open point + slice resource limit impact not visible
Hi all,
First - not sure if the forum is the right place - but wanted to feedback on some possible mistake on the lab pdf document for this section - The two figures "Figure 2.24:systemd-delta showing unit file override" and "Figure 2.27:systemd-delta showing unit file and dropin file" are identical if i am not mistaken..
Then I have problem to see any effects on the last exercice when using systemd slice with a low CPU quota.
I can confirm the service is launched using foo.slice - seen under cgroup with "using systemctl status foo" as well with the script "track-stress.sh" provided but eventually no visible effect on overall CPU consumption..
Anyone has seen this problem and what could be the causes ?
This was tested under Centos 8 and Ubuntu LTS 20.04 with similar results...
Thanks,
Sylvain
Comments
-
Thank you for the feed back ! Yes,2.24 and 2.27 are the same in the book but we know from adding in the "sropin file" the stress counters should show 1 process for each sectiion. This has been fixed in the version due to hit the streets very soon.
On the "slice " lab are you seein g"system.slice" or "foo.slice" ? I'm betting on "system.slice" You see CentOS8 moved the files areound a bit.
Add:
Slice=foo.slice
CPUQuota=30%As the last 2 lines in your:
/etc/systemd/system/foo.service.d/00-foo.confThe test should show the foo.slice and the 30% limit will be enforced.
Yes, this fix is in the new verion.
Sorry for having some difficulties , we test the labs often and appreciate feedback to plug any problems that surface..
Regards Lee
1 -
Thanks Lee for your feedback,
I can confirm "foo.slice" is used - as printed from the script provided and also seen with 'systemctl status foo' command showing "CGroup: /foo.slice/foo.service"
I assume the CPUQuota is not enforced here in my case and something missing.
Looking at output of this command : "systemctl show foo |grep CPU" listed below, I assume parameter setting is not correct.CPUUsageNSec=[not set]
EffectiveCPUs=
CPUAccounting=no
CPUWeight=[not set]
StartupCPUWeight=[not set]
CPUShares=[not set]
StartupCPUShares=[not set]
CPUQuotaPerSecUSec=infinity
CPUQuotaPeriodUSec=infinity
AllowedCPUs=
LimitCPU=infinity
LimitCPUSoft=infinity
CPUSchedulingPolicy=0
CPUSchedulingPriority=0
CPUAffinity=
CPUSchedulingResetOnFork=no0 -
Now that is interesting. But it is working, look at the %CPU in the track-STRESS.sh , it adds up to 30%. If you wish change the percentage in the service file, it will reflect in the track-STRESS.sh.
As to the systemctl show command, and seeing the parameter, I'll have to look into that as it is not obvious where the value is.Lee
0 -
I'm reasonabley certain the value is stored in:
/sys/fs/cgroup/cpu,cpuacct/foo.slice/foo.service/cpu.cfs_quota_us
Mine is set to 33% and the above link is 33000.
As for why we cannot see it, that is another investigation.Regards Lee
0 -
Think I found it. My value of CPUQuotaPerSecUSec=330ms looks right as that would be 0.33 seconds or 33% of a second.
0 -
Well, my initial concern is that the overall CPU consumption seen is not changing whatever the foo.slice is on or not and with CPUQUOTA as low as 10% - see below output of track-STRESS script for both cases.
I guess CPU quota is not enforced.. and I cannot see any foo.slice folder under /sys/fs/cgroup/cpu,cpuacct/ when foo.slice is running.
$ sudo find /sys/fs/cgroup/ -name "foo.slice"
/sys/fs/cgroup/memory/foo.slice
/sys/fs/cgroup/pids/foo.slice
/sys/fs/cgroup/devices/foo.slice
/sys/fs/cgroup/systemd/foo.sliceCan you show what parameter do you use with your foo.slice config file ?
Also confirm on your working case what value do you get with command "systemctl show foo |grep -i quota" when foo.slice is running ?My outputs below.
With system.slice :
./track-STRESS.sh is running
The pid for stress is 738953
PID PPID COMMAND VSZ %CPU PSR SLICE
738953 1 stress 7952 0.0 3 system.slice
738954 738953 stress 7952 98.5 3 system.slice
738955 738953 stress 7952 97.1 0 system.slice
738956 738953 stress 139028 98.4 1 system.slicewith foo.slice + CPUQuota at 10%
./track-STRESS.sh is running
The pid for stress is 736929
PID PPID COMMAND VSZ %CPU PSR SLICE
736929 1 stress 7952 0.0 2 foo.slice
736930 736929 stress 7952 98.5 2 foo.slice
736931 736929 stress 7952 97.5 0 foo.slice
736932 736929 stress 139028 98.6 3 foo.sliceMy config files under /etc/systemd/system/foo.service.d
$ cat 00-foo.conf
[Service]
ExecStart=
ExecStart=/usr/bin/stress --cpu 1 --vm 1 --io 1 --vm-bytes 128M
Slice=foo.slice$ cat foo.slice
[Unit]
Description=stress slice
[Slice]
CPUQuota=10%0 -
1 delete the file "foo.slice"
2 Add:
Slice=foo.slice
CPUQuota=30%As the last 2 lines in your:
/etc/systemd/system/foo.service.d/00-foo.confThis is assuming you are using CentOS-8. We used the file foo.slice with CentOS-7 and do not need it for CentOS-8.
0 -
Thanks...Indeed, tested initially and not working with Centos 8 and Ubuntu LTS 20.04 as written on my first post..
Now tested and working under Centos 8 with your last comment. where overall %CPU is now in line with CPUQuota.
Not sure however how to check CPU quota is enforced looking at service once running. I was assuming CPUQouta would have been reflected somewhere using command like 'systemctl show foo'
Correction not tested with Ubuntu 20.04
0 -
Other than the CPUQuotaPerSecUSec value that should track with the CPUQuota percentage, I'm looking for an alternative.
The script track-STRESS.sh was created to collect the cpu utilization used by the primary and spawned proceses so we could see that the quota is working.Lee
0
Categories
- All Categories
- 177 LFX Mentorship
- 177 LFX Mentorship: Linux Kernel
- 754 Linux Foundation IT Professional Programs
- 374 Cloud Engineer IT Professional Program
- 170 Advanced Cloud Engineer IT Professional Program
- 74 DevOps IT Professional Program - Discontinued
- 5 DevOps & GitOps IT Professional Program
- 100 Cloud Native Developer IT Professional Program
- 7.6K Training Courses & Learning Paths
- 2 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 5 Cloud & Containers Training
- 1 Cybersecurity Training
- 2 DevOps & Site-Reliability Training
- 1 Linux Kernel Development Training
- 1 Networking Training
- 2 Open Source Best Practice Training
- 2 System Administration Training
- 1 System Engineering Training
- 1 Web & Application Development Training
- 794 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 95 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 89 Storage
- 769 Linux Distributions
- 81 Debian
- 68 Fedora
- 22 Linux Mint
- 13 Mageia
- 24 openSUSE
- 150 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 465 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 98 Linux Security
- 78 Network Management
- 101 System Management
- 46 Web Management
- 111 Mobile Computing
- 19 Android
- 77 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 393 Off Topic
- 121 Introductions
- 182 Small Talk
- 29 Study Material
- 976 Programming and Development
- 310 Kernel Development
- 648 Software Development
- 990 Software
- 382 Applications
- 182 Command Line
- 5 Compiling/Installing
- 68 Games
- 317 Installation
- Archived
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)
