Creating VM nodes on QEMU/KVM with Ubuntu

If you have a decent multi-core CPU with enough RAM running Ubuntu there's no reason not to use it for this course instead of a cloud service.
You should already have QEMU/KVM setup and a ssh key created using ssh-keygen -t rsa
.
First thing you need to do is make sure you have a virtual bridge. In Ubuntu 22.04 you should already have one called virbr0.
- $ ip link show type bridge
- $ ip addr show virbr0
- 5: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
- link/ether 52:54:00:c3:12:65 brd ff:ff:ff:ff:ff:ff
- inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
- valid_lft forever preferred_lft forever
You can see our static address range is 192.168.122.1/24. So let's add some host names to our /etc/hosts
- 192.168.122.191 mycluster-cp1
- 192.168.122.192 mycluster-cp2
- 192.168.122.193 mycluster-cp3
- 192.168.122.194 mycluster-w1
- 192.168.122.195 mycluster-w2
- 192.168.122.196 mycluster-w3
- 192.168.122.197 mycluster-w4
Create a file called user-data.yml
and add the following:
- #cloud-config
- autoinstall:
- version: 1
- interactive-sections: []
- ssh:
- install-server: true
- allow-pw: true
- authorized-keys:
- - [SSH_RSA]
- user-data:
- disable_root: false
- identity:
- hostname: ubuntu-server
- username: ubuntu
- password: [ROOT_PASSWORD]
- early-commands: []
- late-commands:
- - swapoff -a
- - sed -i '/swap/ s/^\(.*\)$/#\1/g' /target/etc/fstab
- - echo 'ubuntu ALL=(ALL) NOPASSWD:ALL' > /target/etc/sudoers.d/ubuntu
- - chmod 440 /target/etc/sudoers.d/ubuntu
Paste in your ssh key in [SSH_RSA]
:
- cat ~/.ssh/id_rsa.pub
Change the user@host
to ubuntu@ubuntu-server
To generate a password for root you can run and paste it in the [ROOT_PASSWORD]
section:
- mkpasswd --method=SHA-512
Now run ubuntu-autoinstall-generator.sh to generate the Ubuntu 22.04 iso:
- ./ubuntu-autoinstall-generator.sh -a -u user-data.yml -d ubuntu-autoinstall.iso
Now we use this virt-install.sh
bash script to generate our VM's:
- #!/bin/bash
- HOSTNAME=$1
- CLIENTIP=$2
- VCPUS=${3:-2}
- MEMORY=${4:-2048}
- DISKSIZE=${5:-30}
- DISKPATH=./$HOSTNAME.rawdisk
- MACADDR=RANDOM
- DEVICE=enp3s0
- AUTOCONF=off
- BRIDGE=virbr0
- SERVERIP=
- DNS0IP=192.168.122.1
- DNS1IP=
- GATEWAYIP=192.168.122.1
- NETMASK=255.255.255.0
- LOCATION=./ubuntu-autoinstall.iso
- sudo virt-install \
- --connect=qemu:///system \
- --name $HOSTNAME \
- --memory $MEMORY \
- --vcpus $VCPUS \
- --bridge=$BRIDGE \
- --mac=$MACADDR \
- --autostart \
- --check-cpu \
- --os-type=linux \
- --force \
- --graphics none \
- --virt-type kvm \
- --os-variant=ubuntu22.04 \
- --location $LOCATION,initrd=casper/initrd,kernel=casper/vmlinuz \
- --disk path=$DISKPATH,format=raw,cache=none,bus=virtio,size=$DISKSIZE \
- --debug \
- --noautoconsole \
- --wait=-1 \
- --extra-args="ip=$CLIENTIP:$SERVERIP:$GATEWAYIP:$NETMASK:$HOSTNAME:$DEVICE:$AUTOCONF:$DNS0IP:$DNS1IP console=ttyS0 quiet autoinstall ds=nocloud;s=/cdrom/nocloud/"
Change the value of DEVICE to match your ethernet device:
- $ hostname -I
- 192.168.0.141
- $ ifconfig | grep 192.168.0.141 -a -3
- TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
- enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
- inet 192.168.0.141 netmask 255.255.255.0 broadcast 192.168.0.255
- inet6 fe80::5a5:e6a5:9aee:9e43 prefixlen 64 scopeid 0x20<link>
- ether a8:a1:59:40:ca:d4 txqueuelen 1000 (Ethernet)
- RX packets 45472938 bytes 16695796477 (16.6 GB)
So we should set:
- DEVICE=enp3s0
Now we're finally ready to generate our VMs'!
- #!/bin/bash
- SCRIPT=./virt-install.sh
- $SCRIPT mycluster-cp1 192.168.122.191 2 2048 30
- $SCRIPT mycluster-cp2 192.168.122.192 2 2048 30
- $SCRIPT mycluster-cp3 192.168.122.193 2 2048 30
- $SCRIPT mycluster-w1 192.168.122.194 1 2048 30
- $SCRIPT mycluster-w2 192.168.122.195 1 2048 30
- $SCRIPT mycluster-w3 192.168.122.196 1 2048 30
- $SCRIPT mycluster-w4 192.168.122.197 1 2048 30
If you only want two control planes' and two workers, for example, comment out the mycluster-cp3
, mycluster-w3
and mycluster-w4
lines by prefixing them with a #
character.
Once you have your VMs' created you should ssh into each one and set the correct host name and edit the /etc/hosts
file to add the same hosts as we did before.
- $ sudo nano /etc/hostname
- mycluster-x
- $ sudo nano /etc/hosts
Comments
-
I just commit a k8s-cluster repo which contains Ansible scripts for automating the creation of a k8s cluster on your VMs.
It should be as simple as editing hosts.ini
- [control_plane]
- mycluster-cp1 ansible_host=192.168.122.191
- mycluster-cp2 ansible_host=192.168.122.192
- mycluster-cp3 ansible_host=192.168.122.193
- [workers]
- mycluster-w1 ansible_host=192.168.122.194
- mycluster-w2 ansible_host=192.168.122.195
- mycluster-w3 ansible_host=192.168.122.196
- [all:vars]
- ansible_python_interpreter=/usr/bin/python3
Then run the
install.sh
script- #!/bin/bash
- set -e
- ansible-playbook -i hosts.ini ./init.yml
- ansible-playbook -i hosts.ini ./kube-dependencies.yml
- ansible-playbook -i hosts.ini ./control-planes.yml
- ansible-playbook -i hosts.ini ./workers.yml
By default it will install containerd CRI but aslo includes scripts for installing cri-o and docker.
0 -
The repo has been updated to use
Vagrant
instead ofcloud-config
0
Categories
- All Categories
- 143 LFX Mentorship
- 143 LFX Mentorship: Linux Kernel
- 817 Linux Foundation IT Professional Programs
- 368 Cloud Engineer IT Professional Program
- 167 Advanced Cloud Engineer IT Professional Program
- 83 DevOps Engineer IT Professional Program
- 132 Cloud Native Developer IT Professional Program
- 122 Express Training Courses
- 122 Express Courses - Discussion Forum
- Microlearning - Discussion Forum
- 6.6K Training Courses
- 40 LFC110 Class Forum - Discontinued
- 66 LFC131 Class Forum
- 39 LFD102 Class Forum
- 237 LFD103 Class Forum
- 22 LFD110 Class Forum
- 44 LFD121 Class Forum
- 1 LFD123 Class Forum
- LFD125 Class Forum
- 17 LFD133 Class Forum
- 6 LFD134 Class Forum
- 17 LFD137 Class Forum
- 70 LFD201 Class Forum
- 3 LFD210 Class Forum
- 2 LFD210-CN Class Forum
- 2 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum - Discontinued
- 1 LFD233 Class Forum
- 3 LFD237 Class Forum
- 23 LFD254 Class Forum
- 689 LFD259 Class Forum
- 110 LFD272 Class Forum
- 3 LFD272-JP クラス フォーラム
- 10 LFD273 Class Forum
- 251 LFS101 Class Forum
- 2 LFS111 Class Forum
- 3 LFS112 Class Forum
- 3 LFS116 Class Forum
- 3 LFS118 Class Forum
- 1 LFS120 Class Forum
- 3 LFS142 Class Forum
- 3 LFS144 Class Forum
- 3 LFS145 Class Forum
- 1 LFS146 Class Forum
- 16 LFS148 Class Forum
- 8 LFS151 Class Forum
- 1 LFS157 Class Forum
- 17 LFS158 Class Forum
- LFS158-JP クラス フォーラム
- 5 LFS162 Class Forum
- 1 LFS166 Class Forum
- 3 LFS167 Class Forum
- 1 LFS170 Class Forum
- 1 LFS171 Class Forum
- 2 LFS178 Class Forum
- 2 LFS180 Class Forum
- 2 LFS182 Class Forum
- 4 LFS183 Class Forum
- 30 LFS200 Class Forum
- 737 LFS201 Class Forum - Discontinued
- 2 LFS201-JP クラス フォーラム
- 17 LFS203 Class Forum
- 118 LFS207 Class Forum
- 2 LFS207-DE-Klassenforum
- LFS207-JP クラス フォーラム
- 302 LFS211 Class Forum
- 55 LFS216 Class Forum
- 54 LFS241 Class Forum
- 43 LFS242 Class Forum
- 37 LFS243 Class Forum
- 13 LFS244 Class Forum
- 6 LFS245 Class Forum
- LFS246 Class Forum
- LFS248 Class Forum
- 108 LFS250 Class Forum
- 1 LFS250-JP クラス フォーラム
- LFS251 Class Forum
- 145 LFS253 Class Forum
- LFS254 Class Forum
- 2 LFS255 Class Forum
- 13 LFS256 Class Forum
- 1 LFS257 Class Forum
- 1.3K LFS258 Class Forum
- 11 LFS258-JP クラス フォーラム
- 116 LFS260 Class Forum
- 156 LFS261 Class Forum
- 41 LFS262 Class Forum
- 82 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 23 LFS267 Class Forum
- 25 LFS268 Class Forum
- 29 LFS269 Class Forum
- 7 LFS270 Class Forum
- 200 LFS272 Class Forum
- 1 LFS272-JP クラス フォーラム
- 2 LFS147 Class Forum
- LFS274 Class Forum
- 3 LFS281 Class Forum
- 18 LFW111 Class Forum
- 257 LFW211 Class Forum
- 179 LFW212 Class Forum
- 15 SKF100 Class Forum
- SKF200 Class Forum
- 2 SKF201 Class Forum
- 791 Hardware
- 199 Drivers
- 68 I/O Devices
- 37 Monitors
- 98 Multimedia
- 174 Networking
- 91 Printers & Scanners
- 85 Storage
- 754 Linux Distributions
- 82 Debian
- 67 Fedora
- 16 Linux Mint
- 13 Mageia
- 23 openSUSE
- 149 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 351 Ubuntu
- 465 Linux System Administration
- 39 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 95 Linux Security
- 78 Network Management
- 101 System Management
- 47 Web Management
- 56 Mobile Computing
- 18 Android
- 28 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 366 Off Topic
- 114 Introductions
- 171 Small Talk
- 26 Study Material
- 534 Programming and Development
- 304 Kernel Development
- 223 Software Development
- 1.8K Software
- 212 Applications
- 182 Command Line
- 3 Compiling/Installing
- 405 Games
- 311 Installation
- 79 All In Program
- 79 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)