Infrastructure as Code and Deployment Pipeline for Large number of Application Instances
Use Case
Application is deployed to hundreds of instances for different customers, each has different configuration. Code based is stable, not frequently change. Following tools are used:
- Multi tenant approach can not be considered.
- Application is packed as container image.
- Kubernetes environment, strictly protected, no access to cluster admin privileges.
- Application is deployed with Helm Charts and Azure DevOps pipeline
- Each prod environments has slightly different configuration, like secrets, ConfigMap, K8s resources.
Question and Discussion
Normal CI/CD process is for application development, with frequent code change and one final destination which is prod env.
But is there a standard practice, tools set for deploying and managing one application to hundreds of different prod environments?
Managing one Application instance at a time is currently used, but it is not very GitOps in my opinion, and also not efficient for hundreds of instances.
I found ArgoCD is quite closed for the use case, with IaC pull approach, but can not be used because it needs cluster-admin privilege. (https://argo-cd.readthedocs.io/en/stable)
Overview

Comments
-
@luisviveropena more details about my question.
0 -
@tinphamtan I just watched the recording of your conversation with @luisviveropena. Your situation seems to be unique in the sense you are trying to work with different clients, each with their own cluster. The direction you are exploring is right, in the way you have arrived at ArgoCD.
My opinion is you could possibly solve this using FluxCD + a repository design approach + a layer of RBAC that I have authored in the GitOps course. It would be best if you drop by during my next office hour on Monday, Feb 21st and we could have a discussion about it.
0 -
Hi @gouravshah , many thanks for the assistance with the @tinphamtan 's question! In fact it's a very special use case.
Regards,
Luis.0
Categories
- All Categories
- 178 LFX Mentorship
- 178 LFX Mentorship: Linux Kernel
- 773 Linux Foundation IT Professional Programs
- 383 Cloud Engineer IT Professional Program
- 175 Advanced Cloud Engineer IT Professional Program
- 75 DevOps IT Professional Program - Discontinued
- 7 DevOps & GitOps IT Professional Program
- 102 Cloud Native Developer IT Professional Program
- 7.6K Training Courses & Learning Paths
- 9 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 28 Cloud & Containers Training
- 3 Cybersecurity Training
- 2 DevOps & Site-Reliability Training
- 1 Linux Kernel Development Training
- 2 Networking Training
- 2 Open Source Best Practice Training
- 5 System Administration Training
- 1 System Engineering Training
- 4 Web & Application Development Training
- 798 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 96 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 92 Storage
- 771 Linux Distributions
- 81 Debian
- 68 Fedora
- 23 Linux Mint
- 13 Mageia
- 24 openSUSE
- 151 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 469 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 101 Linux Security
- 79 Network Management
- 101 System Management
- 46 Web Management
- 150 Mobile Computing
- 20 Android
- 115 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 404 Off Topic
- 126 Introductions
- 34 Study Material
- 1K Programming and Development
- 310 Kernel Development
- 717 Software Development
- 1K Software
- 416 Applications
- 182 Command Line
- 5 Compiling/Installing
- 71 Games
- 320 Installation
- Archived
- 183 Small Talk
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)
