Skip to content
    • Welcome to the Linux Foundation Forum!

    Use DNS names vs IP for etcd and kube-apiserver? (re: Lab 3.1)

    Posts: 9
    in LFS258 Class Forum

    It seems that when you install k8, etcd and kube-apiserver is configured to use the IP of the k8 master. That is an issue to me as I do tear down my environment and start it back up.

    Is there a way to tell to use the hostname/dns name of the master rather than the IP?

    Welcome!

    It looks like you're new here. Sign in or register to get started.
    Sign In

    Comments

    • Posts: 1,000

      Hello,

      The x509 certificates will only work with the server name passed to kubeadm init. I would suggest starting over and following the entire directions, where you configure the k8smaster alias and use it. This will become essential when you try to get HA to work.

      Regards,

    • Posts: 2,434

      Hi @rilindo,

      In some environments the VMs get to keep their private IP addresses between restarts. In others, you may assign static IP addresses to your VMs.

      Are you using a cloud or local infrastructure?

      Regards,
      -Chris

    • Posts: 9

      @serewicz This is how I configure things, per instructions:

      1. root@k8smaster:~# cat kubeadm-config.yaml 
      2. apiVersion: kubeadm.k8s.io/v1beta2
      3. kind: ClusterConfiguration
      4. kubernetesVersion: stable
      5. controlPlaneEndpoint: "k8smaster:6443"
      6. networking:
      7.   podSubnet: 192.168.0.0/16
      8. root@k8smaster:~# cat /etc/hosts
      9. # Your system has configured 'manage_etc_hosts' as True.
      10. # As a result, if you wish for changes to this file to persist
      11. # then you will need to either
      12. # a.) make changes to the master file in /etc/cloud/templates/hosts.debian.tmpl
      13. # b.) change or remove the value of 'manage_etc_hosts' in
      14. #     /etc/cloud/cloud.cfg or cloud-config from user-data
      15. #
      16. 127.0.0.1 localhost
      17.  
      18. # The following lines are desirable for IPv6 capable hosts
      19. ::1 ip6-localhost ip6-loopback
      20. fe00::0 ip6-localnet
      21. ff00::0 ip6-mcastprefix
      22. ff02::1 ip6-allnodes
      23. ff02::2 ip6-allrouters
      24. ff02::3 ip6-allhosts
      25.  
      26. 10.70.60.49 k8smaster k8smaster
      27.  
      28. /usr/bin/kubeadm init --config=/root/kubeadm-config.yaml --upload-certs |  tee /root/kubeadm-init.out

      Essentially, what it says in the lab

      @chrispokorni I am using scaleway as a cloud provider and they don't allow you to assign IP addresses manually. :neutral:

      I am not against having to use Tier 1 provider like AWS (since they provide that capability), but I am hoping that it doesn't come to that.

    • Posts: 1,000
      edited September 2020

      Hello,

      Could you indicate where you see it using the IP instead of the k8smaster alias?

      Could you show grep server .kube/config output please.

      Regards,

    • Posts: 1,000

      Hello,
      Also what operating system and cloud provider or host are you using?

      I note this in your output:

      1. Your system has configured 'manage_etc_hosts' as True.
      2.  
      3. # As a result, if you wish for changes to this file to persist
      4. # then you will need to either
      5. # a.) make changes to the master file in /etc/cloud/templates/hosts.debian.tmpl
      6. # b.) change or remove the value of 'manage_etc_hosts' in
      7. #     /etc/cloud/cloud.cfg or cloud-config from user-data

      Regards,

    • Posts: 9

      @serewicz Here is my kube config:

      1. gstudent@k8smaster:~$ grep server .kube/config 
      2.     server: https://k8smaster:6443
      3. student@k8smaster:~$

      The IPs in question are located here:

      1. root@k8smaster:~# find /etc/ -type f -exec grep -l 10.68.68.191 {} \;
      2. /etc/hosts
      3. /etc/kubernetes/manifests/etcd.yaml
      4. /etc/kubernetes/manifests/kube-apiserver.yaml

      Also:

      Also what operating system and cloud provider or host are you using?

      I am using Ubuntu Bionic on Scaleway.

      1. root@k8smaster:~# uname -a
      2. Linux k8smaster 4.15.0-115-generic #116-Ubuntu SMP Wed Aug 26 14:04:49 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
      3. root@k8smaster:~# cat /etc/lsb-release 
      4. DISTRIB_ID=Ubuntu
      5. DISTRIB_RELEASE=18.04
      6. DISTRIB_CODENAME=bionic
      7. DISTRIB_DESCRIPTION="Ubuntu 18.04.3 LTS"

      And

      I note this in your output:

      Scaleway uses cloud-init, which does some configuration inject at start. I had it off and turn it back on (since I am using ansible to reconfigure the the host file):

      1.   - /usr/bin/ansible 127.0.0.1 -m lineinfile -a 'dest=/etc/hosts regexp=".*k8smaster.*" line="{{ ipaddress }} k8smaster k8smaster" state=present' -e ipaddress=$(ifdata -pa ens2)
    • Posts: 9

      Alright, I bit the bullet and switch over to AWS, which allowed me to set a static private IP. That said. . . . maybe I should try a different approach, since it seems that AWS behavior on static private IPs seems to be inconsistent.

      If the the master somehow start up with a different IP, is it possible to re-run kubeadm init to rebuild the configuration with a different IP?

    • Posts: 2,434

      I have been using Google Cloud GCE VM instances for my Kubernetes clusters for a few years now, and have not encountered any issues when re-starting my clusters. That is probably because GCE keeps the private IPs static in my custom VPC network.

      There is a kubeadm reset command you could run on master and worker nodes if this is something you desire, but the command itself is not perfect, as it leaves behind configuration options which need to be cleaned up manually post-reset, otherwise you will not be able to seamlessly re-join your nodes in a cluster. Additional cleanup steps are described here.

      However, unless this process is scripted/automated, I find this to be a counterproductive approach.

      Regards,
      -Chris

    • Posts: 9

      @chrispokorni Sounds like at some point I may need to start using Google Cloud GCE to get some sort of first class support for Kubenetes. FWIW, after some refactoring my lab (enlarging my CIDR to avoid IP address complexity), the AWS setup seems to be working out well, so I will continue on that as of this time.

      Thanks to y'all for your help!

    Welcome!

    It looks like you're new here. Sign in or register to get started.
    Sign In

    Welcome!

    It looks like you're new here. Sign in or register to get started.
    Sign In

    Quick Links

    Categories

    Upcoming Training