As we continue writing this serie , we come to the part were we are going to deploy our apps to our Azure Kubernetes service using Azure Devops
This article is a part of a series:
- Part 1 : How to setup nginx reverse proxy for aspnet core apps with and without Docker compose
- Part 2 :How to setup nginx reverse proxy && load balancer for aspnet core apps with Docker and azure kubernetes service
- Part 3 : How to configure an ingress controller using TLS/SSL for the Azure Kubernetes Service (AKS)
- Part 4 : switch to Azure Container Registry from Docker Hub
- Part 5-A: Using Azure DevOps, Automate Your CI/CD Pipeline and Your Deployments (setup)
- Part 5-B : Using Azure DevOps, Automate Your CI/CD Pipeline and Your Deployments (terraform)
- Part 5-C : Using Azure DevOps, Automate Your CI/CD Pipeline and Your Deployments (deployments)
- Part 6 : Using Github, Automate Your CI/CD Pipeline and Your Deployments
- Possible methods to reduce your costs .
Introduction :
Auto deploying deployment using Azure DevOps and AKS (Azure Kubernetes Service) is a powerful way to streamline the deployment process for containerized applications. With Azure DevOps, you can create automated deployment pipelines that trigger a release whenever new code is pushed to a repository. AKS provides a fully managed Kubernetes service that simplifies the deployment and operation of containerized applications, ensuring high availability, scalability, and security for production deployments. By integrating Azure DevOps with AKS, you can deploy applications to the cluster with a single click, and easily roll back deployments to a previous version if needed. This approach enables teams to deliver updates and new features to production more quickly and reliably, while minimizing the risk of errors or downtime.In different blog post we have seen how to deploy our infrastructure , right now , one more step , is auto deploying to aks .
Prerequisites
– Created service connection for azure container registry .
– Create a service connection for azure Kubernetes service .
1-Creating our Pipeline
Our pipeline will have different steps and we will explain each part in this part:
Full pipline
name: $(BuildDefinitionName)_$(date:yyyyMMdd)$(rev:.r)
trigger:
branches:
include:
- dev
- master
#our agent
pool:
name: demo-privateAgentDevOps
demands:
- Agent.Name -equals DevopsAg01
variables:
imageRepository: 'mydotnetappdemo'
containerRegistry: 'crdvsaksdevfc01.azurecr.io'
containerRegistryspn: 'acr-aks-001'
dockerfilePath: '$(Build.SourcesDirectory)/Dockerfile'
hostnamesManifest: '$(Pipeline.Workspace)/manifests/01-backend-acr-deployment.yml'
frontendManifest: '$(Pipeline.Workspace)/manifests/01-nginx-frontend.yml'
ingressManifest: '$(Pipeline.Workspace)/manifests/ingress.yml'
imagePullSecret: 'context-auth'
kubernetesServiceConnection: 'aksspn'
hostnameImageRepo: 'mydotnetappdemo'
tag: '$(Build.BuildId)'
stages:
- stage: Build
condition: and(succeeded(), ne(variables['Build.Reason'], 'PullRequest'))
displayName: Build and push Docker image to ACR
jobs:
- job: Build
displayName: Restore project
steps:
- task: DotNetCoreCLI@2
displayName: 'Restore packages'
inputs:
command: 'restore'
projects: '**/*.csproj'
- task: Docker@2
displayName: 'Build Project'
inputs:
containerRegistry: $(containerRegistryspn)
repository: '$(imageRepository)'
command: 'build'
Dockerfile: '**/Dockerfile'
tags: |
$(tag)
latest
- task: Docker@2
displayName: 'Push Docker image'
inputs:
containerRegistry: $(containerRegistryspn)
repository: $(imageRepository)
command: 'push'
tags: |
$(tag)
latest
- task: PublishPipelineArtifact@1
inputs:
targetPath: '$(Pipeline.Workspace)/s/manifests'
artifact: 'manifests'
publishLocation: 'pipeline'
- stage: DEV
condition: and(succeeded(), ne(variables['Build.Reason'], 'PullRequest'))
displayName: DEV - Deploy API to AKS
dependsOn: Build
jobs:
- deployment: Deploy
displayName: Deploy DEV
environment: 'development'
strategy:
runOnce:
deploy:
steps:
- task: DownloadPipelineArtifact@2
inputs:
buildType: 'current'
artifactName: 'manifests'
targetPath: '$(Pipeline.Workspace)/manifests'
- task: replacetokens@3
displayName: Replace Build tag & environment values
inputs:
rootDirectory: '$(Pipeline.Workspace)/manifests/'
targetFiles: '*.yml'
encoding: 'utf-8'
writeBOM: true
actionOnMissing: 'warn'
keepToken: false
tokenPrefix: '#{'
tokenSuffix: '}#'
useLegacyPattern: false
enableTransforms: false
enableTelemetry: false
- task: KubernetesManifest@1
inputs:
action: 'createSecret'
connectionType: 'azureResourceManager'
azureSubscriptionConnection: 'terrafromspn'
azureResourceGroup: 'azure-loves-terraform-2023'
kubernetesCluster: 'achrafdoingaks'
secretType: 'dockerRegistry'
secretName: $(imagePullSecret)
dockerRegistryEndpoint: 'acr-aks-001'
- task: KubernetesManifest@0
displayName: Deploy to Kubernetes cluster
inputs:
action: deploy
kubernetesServiceConnection: $(kubernetesServiceConnection)
namespace: 'ingress'
manifests: |
$(hostnamesManifest)
$(ingressManifest)
imagePullSecrets: |
$(imagePullSecret)
containers: |
$(containerRegistry)/$(hostnameImageRepo):$(tag)
- task: PublishBuildArtifacts@1
displayName: Publish Swaggers
inputs:
PathtoPublish: '$(Build.ArtifactStagingDirectory)'
ArtifactName: 'swagger-dev'
publishLocation: 'Container'
What will the pipeline look like :
Now let’s understand this pipeline by task :
The first stage of our pipeline will consist of building our project (dotnet ) , building the docker image and pushing it to our azure container registry .
The second part , will run only if the first stage is done with success .
replacetokens@3
Replace Tokens is an extension that can be used in Azure DevOps, which provides the possibility to replace tokens in the code files with variables values (which can be configured in the Pipelines Library) during the execution of the CI/CD process.
In our case , in each time we build our solution we want to update our deployment the build tag of the new image that we have created .
You may say why not using latest ?
When deploying Docker images, it is generally recommended to avoid using the “latest” tag and instead use a specific version or build tag. The reason for this is that the “latest” tag is a floating tag that always points to the most recent build of an image. This can lead to unpredictability and make it difficult to manage and track the versions of deployed images.
By using a specific version or build tag, you can ensure that the same version of an image is deployed consistently across different environments, such as development, testing, and production. This can also make it easier to troubleshoot issues and roll back to a previous version if necessary.
When using build tags, it is common to use a versioning scheme that includes the version number and the Git commit hash or build ID. This enables you to track the version of the code that was used to build the image and ensure consistency across different environments.
In summary, it is generally better to use a specific version or build tag when deploying Docker images, rather than relying on the “latest” tag, to ensure consistency and predictability in your deployment process.
- task: replacetokens@3
displayName: Replace Build tag & environment values
inputs:
rootDirectory: '$(Pipeline.Workspace)/manifests/'
targetFiles: '*.yml'
encoding: 'utf-8'
writeBOM: true
actionOnMissing: 'warn'
keepToken: false
tokenPrefix: '#{'
tokenSuffix: '}#'
useLegacyPattern: false
enableTransforms: false
enableTelemetry: false
this task will replace the code inside the #{Build.BuildId}# below inside our deployement file with the build id of our pipline
containers:
- name: backend-restapp
image: crdvsaksdevfc01.azurecr.io/mydotnetappdemo:#{Build.BuildId}#
KubernetesManifest@1
The Create imagePullSecret parameter in the KubernetesManifest@1 task in Azure DevOps is used to create a Docker registry credential secret in the target Kubernetes cluster.
When you deploy a container to a Kubernetes cluster, the container image is typically stored in a Docker registry, such as Docker Hub or Azure Container Registry. In order to pull the image from the registry, the Kubernetes cluster needs to be authenticated with the registry using credentials, such as a username and password or a token.
To avoid storing these credentials in plaintext in the Kubernetes manifest, you can create an image pull secret that contains the credentials and reference it in the manifest file. The KubernetesManifest@1 task in Azure DevOps can create this image pull secret for you by specifying the Docker registry server, username, and password as task inputs.
When you enable the Create imagePullSecret parameter in the KubernetesManifest@1 task, Azure DevOps creates a secret in the target Kubernetes cluster that contains the Docker registry credentials. The secret is named “acr-credentials” and can be referenced in the manifest file using the “imagePullSecrets” field.
By creating the image pull secret with Azure DevOps, you can securely authenticate your Kubernetes cluster with your Docker registry and ensure that your container images can be pulled successfully during deployment.
- task: KubernetesManifest@1
inputs:
action: 'createSecret'
connectionType: 'azureResourceManager'
azureSubscriptionConnection: 'terrafromspn'
azureResourceGroup: 'azure-loves-terraform-2023'
kubernetesCluster: 'achrafdoingaks'
secretType: 'dockerRegistry'
secretName: $(imagePullSecret)
dockerRegistryEndpoint: 'acr-aks-001'
Now time to deploy :
- task: KubernetesManifest@0
displayName: Deploy to Kubernetes cluster
inputs:
action: deploy
kubernetesServiceConnection: $(kubernetesServiceConnection)
namespace: 'ingress'
manifests: |
$(hostnamesManifest)
$(ingressManifest)
imagePullSecrets: |
$(imagePullSecret)
containers: |
$(containerRegistry)/$(hostnameImageRepo):$(tag)
The “action: deploy” in the “KubernetesManifest@0” task in Azure DevOps specifies that the task should deploy the Kubernetes manifests to the target cluster.
The “KubernetesManifest@0” task is used to deploy Kubernetes manifests, which are YAML or JSON files that define Kubernetes resources, such as pods, services, and deployments. The task allows you to specify the manifest files, the Kubernetes cluster to deploy to, and various other parameters that control the deployment process.
When the “action” parameter is set to “deploy”, the task will create or update the resources in the target Kubernetes cluster based on the manifest files provided. If a resource does not exist, it will be created. If a resource already exists, it will be updated to match the configuration in the manifest file.
The “KubernetesManifest@0” task can also be configured to perform other actions, such as deleting resources or running custom kubectl commands. However, when the “action” parameter is set to “deploy”, the task will only deploy the manifests to the target cluster.
Overall, the “KubernetesManifest@0” task with “action: deploy” is a powerful tool for automating the deployment of Kubernetes resources in Azure DevOps, allowing you to quickly and easily deploy your applications and services to a Kubernetes cluster.
2-Creating Our Manifest Files
In our pipeline we are deploying an Ingress and a deployment.
Deployment file :
apiVersion: apps/v1
kind: Deployment
metadata:
name: backend-restapp
namespace: ingress
labels:
app: backend-restapp
tier: backend
spec:
replicas: 2
selector:
matchLabels:
app: backend-restapp
template:
metadata:
labels:
app: backend-restapp
tier: backend
spec:
containers:
- name: backend-restapp
image: crdvsaksdevfc01.azurecr.io/mydotnetappdemo:#{Build.BuildId}#
ports:
- containerPort: 5000
---
apiVersion: v1
kind: Service
metadata:
name: my-backend-service ## VERY VERY IMPORTANT - NGINX PROXYPASS needs this name
labels:
app: backend-restapp
tier: backend
spec:
selector:
app: backend-restapp
ports:
- name: http
port: 5000 # ClusterIP Service Port
targetPort: 5000 # Container Port
type: ClusterIP
Ingress
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: webapp
namespace: ingress
annotations:
nginx.ingress.kubernetes.io/ssl-redirect: "false"
nginx.ingress.kubernetes.io/use-regex: "true"
nginx.ingress.kubernetes.io/rewrite-target: /$1
spec:
ingressClassName: nginx
rules:
- http:
paths:
- backend:
service:
name: my-backend-service
port:
number: 5000
path: /
pathType: Prefix
- backend:
service:
name: my-backend-service
port:
number: 5000
path: /acr(/|$)(.*)
pathType: Prefix
- host: himhelloworld.com
http:
paths:
- backend:
service:
name: my-backend-service
port:
number: 5000
path: /
pathType: Prefix
- backend:
service:
name: my-backend-service
port:
number: 5000
path: /acr
pathType: Prefix
Results :
