SEARCH (ENTER TO SEE ALL RESULTS)
Cancel Search
POPULAR TOPICS
Contributed
sponsored-post-contributed
News
Analysis
The New Stack Makers
Tutorial
Podcast
Feature
Research
Profile
The New Stack Logo
Skip to content
  • Podcasts
  • Events
  • Ebooks
    • DevOps
    • DevSecOps
    • Docker Ecosystem
    • Kubernetes Ecosystem
    • Microservices
    • Observability
    • Security
    • Serverless
    • Storage
    • All Ebooks
  • Newsletter
  • Sponsorship
  • • • •
    • Podcasts
      • TNS @Scale Series
      • TNS Analysts Round Table
      • TNS Context Weekly News
      • TNS Makers Interviews
      • All Podcasts
    • Events
    • Ebooks
      • DevOps
      • DevSecOps
      • Docker Ecosystem
      • Kubernetes Ecosystem
      • Microservices
      • Observability
      • Security
      • Serverless
      • Storage
      • All Ebooks
    • Newsletter
    • Sponsorship
Skip to content
  • Architecture
    • Cloud Native
    • Containers
    • Edge/IoT
    • Microservices
    • Networking
    • Serverless
    • Storage
  • Development
    • Development
    • Cloud Services
    • Data
    • Machine Learning
    • Security
  • Operations
    • CI/CD
    • Culture
    • DevOps
    • Kubernetes
    • Monitoring
    • Service Mesh
    • Tools
Search The New Stack
 

CI/CD

▾ 6 MINUTE READ — CLOSE

Understanding CI/CD Automation
The continuous integration and continuous delivery (CI/CD) method are transforming DevOps. Even if each step of the software development lifecycle can be carried out manually, CI/CD automates the stages in software development and deployment.
Continuous Integration (CI)
Continuous integration is the process of merging code (updates or existing features) with an existing codebase (software tool or product, for example). CI is a development practice where developers merge code in a central repository several times daily.

In CI, each line of code added to the codebase triggers a sequence in a CI/CD pipeline, generating feedback to developers. This process allows improvements to be made quickly and easily.
Continuous Delivery (CD)
CD is the attempt to speed up and automate deployments. An operator can push out multiple deployments in a week across numerous services and know the exact condition of the applications and infrastructure in the course of the deployments.

“Continuous delivery is the natural extension of continuous integration, an approach in which teams ensure that every change to the system is releasable, and release any version with the push of a button. Continuous delivery aims to make releases boring so that we can deliver frequently and get quick feedback on what users care about.” — Thought Works

The Focus of a CI/CD Pipeline
To run a CI/CD pipeline successfully, organizations should outline goals that guide developers’ approaches and processes. While each pipeline is unique, it should reflect some overarching goals.

Here are some results that should be the focus of the pipeline:
Quick Fixes and Improvements in Subsequent Updates
CI/CD automation allows code changes to reflect in end users’ software automatically. CI/CD pipelines should prioritize quick fixes and improvements to existing code to improve software quality and user experience.
Push Button Deployments
Continuous delivery requires a “state” machine, which is not provided by CI tools. CD tools, such as Spinnaker, have the ability to take an environment from one state to the next until it makes it all the way to production. The machine will move the environment, such as Docker containers, through to production in an automated fashion. It will even have the ability to do things such as rollbacks, canary deployments, and scaling instances. This process allows for the agile, push-button, automated deployments that an ideal CD mindset drives towards. Such pipelines are at the core of CD capabilities because they orchestrate a repeatable deployment over stages.
Fast and Frequent Software Releases
One of the higher-level achievements in a DevOps transformation is continuous delivery. Focusing on software releases in a CI/CD pipeline is a cultural shift for companies because it involves organizational change, too. DevOps transformation means building cross-functional teams with common goals, aligning the organization around the architecture and creating a culture of continuous improvement.
The Structure of an Effective CI/CD Workflow
The process for achieving CI/CD goals has been broken down into six stages. The goal is to ensure that new and runnable code is fit for use before it’s sent out to end-users.

Most unique and effective pipelines mirror the following structure:

Each new pipeline run is triggered by a change in the source code repository. An update or variation to the existing code — such as automated workflows or results from a previous pipeline run — begins the CI/CD process.
In this stage, runnable instances of code that could potentially be deployed to end-users are created. This is done through a combination of source code and its dependencies. Code that does not pass this stage indicates a problem with the project’s configuration and should receive immediate attention.
Automated tests are run on the code to determine its accuracy. These tests, created by software developers, are required to meet certain standards. Multiple tests run at this stage would detect bugs or other problems developers do not foresee. The test could take minutes or several hours, depending on its complexity. Code that does not successfully pass this test stage instantly notifies the development team that adjustments need to be made.
After code is tested and considered runnable, it’s delivered to the repository.
Deploy. Once code passes all predefined tests, the runnable code in the repository is deployed into different environments, such as a staging environment for the internal team and a production environment for end-users.
Validation and Compliance. Organizational needs determine what takes place in validation and compliance. For example, image security scanning tools ensure image quality and match them against known vulnerabilities.

The Approach to Cloud Native CI/CD Tools Is Changing
An increasing focus on continuous delivery (CD) has brought new tools and practices that allow teams to produce frequent, fast, and, above all, boring automated releases. Cloud native CI/CD requires a deeper understanding of DevOps practices and how they affect the way organizations deploy and manage workloads using containers, microservices, and serverless functions.

A new approach to continuous integration and continuous delivery (CI/CD) is emerging for cloud native architectures. With cloud native architectures, complexity is shifting away from building and assembly of code towards orchestration of releases. Build tools such as Travis CI and Jenkins are starting to commoditize and become much simpler. As more and more organizations get comfortable with building custom code using containers and other immutable constructs, they spend fewer cycles on building that code and shift into solving the problems of orchestrated releases.
Impact of Kubernetes CI/CD
Kubernetes, the open source container orchestrator, makes CD easier to execute with tools, modularity, and immutable infrastructure. Kubernetes simplifies deployment and monitoring of microservices. It helps define a container deployment and manage instances but leaves it up to the user to automate those deployments into environments.

Here are some proven practices for improving Kubernetes CI/CD:

Implementing Blue-Green Deployment Strategy. Similar to the way we prepare for emergencies, this strategy involves a pattern that creates an additional set of production instances to existing instances for quick switching in case of failure or downtime. The blue represents the staging environment, while the green represents the production environment.
Leveraging Git-Based Workflows. CI/CD pipelines should be activated through GitOps. This ensures that changes and source code in the pipeline are stored in a unified source repository for ease of correction and deployment.
Testing and Scanning New Container Images. Testing and scanning container images every time a new image is created can handle vulnerabilities such as configuration issues introduced with new builds. It also ensures that commands are working properly.

Challenges with the CI/CD Framework
As much as the CI/CD process is evolving, it is not without challenges. Some difficulties faced include:

Version Control. The CI/CD model requires the creation of versions from the source code repository to ensure continuity. Managing these variations can be difficult because of the number of changes made.
Faulty Tests. As new code is written, developers are expected to write multiple tests to determine the accuracy and behavior of products. If the right tests aren’t administered, developers may receive faulty feedback loops, which could affect the end product entirely.
Security Breaches. Concerns have been raised on the security of the CI/CD process in the development, integration, and deployment phases. Software developers are urged to develop security measures alongside the code writing process and not at the end of the cycle.

CI/CD practices are constantly getting refined. Learn more about CI/CD trends, new approaches, and opinions of industry experts through The New Stack articles in this category.


The New Stack Newsletter Sign-Up
A newsletter digest of the week’s most important stories & analyses.
Do you also want to be notified of the following?
We don’t sell or share your email. By continuing, you agree to our Terms of Use and Privacy Policy.
CI/CD / DevOps / Sponsored
Kick the Tires on Spinnaker with Armory’s Minnaker
4 May 2021 10:33am, by Mike Melanson
CI/CD / DevOps / Kubernetes / Sponsored
Red Hat Delivers Full GitOps CI/CD Built on Tekton and Argo
4 May 2021 9:42am, by Mike Melanson
CI/CD / Cloud Native Ecosystem / Kubernetes / Sponsored / Contributed
Why Argo CD Is the Lifeline of GitOps
4 May 2021 6:19am, by Alex Handy
CI/CD / Tools / Sponsored / Contributed
Elixir SDK for ConfigCat
3 May 2021 12:00pm, by Randy Coulman
CI/CD / Frontend Development / Software Development
Slow Jamstack Builds: Netlify’s Solution Is Distributed Persistent Rendering
26 Apr 2021 9:00am, by Richard MacManus
CI/CD / Kubernetes / Security
Accurics Extends Terrascan Vulnerability Detection into the Kubernetes Runtime
21 Apr 2021 3:00pm, by B. Cameron Gain
CI/CD / Open Source / Security
Not Your Usual Supply Chain Hack: The Codecov Bash Uploader Blunder
21 Apr 2021 9:24am, by Steven J. Vaughan-Nichols
CI/CD / DevOps / Sponsored / Contributed
A Business Perspective on CI/CD Pipelines
20 Apr 2021 10:34am, by Ismail Egilmez
CI/CD / DevOps / Software Development / Contributed
Project Management for the Next 50 Million Developers
19 Apr 2021 10:09am, by Aaron Upright
CI/CD / DevOps / Observability / Sponsored / Contributed
4 Ways to Measure Your Software Delivery Performance
16 Apr 2021 8:58am, by Aravind Kannan
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Cloud Native Ecosystem / DevOps / Sponsored
How eBay Works for Developer Speed
12 Apr 2021 1:57pm, by Alex Williams and B. Cameron Gain
CI/CD / Software Development / Sponsored / Contributed
The Unexpected Costs of Flaky Tests
6 Apr 2021 12:00pm, by Serkan Özal
CI/CD / Microservices / Software Development / Sponsored / Contributed
Migration from Monolith to Feature Module
5 Apr 2021 11:00am, by Sangeetha Rao
CI/CD / Kubernetes / Security
CircleCI Extends CI/CD Platform Beyond the Cloud
1 Apr 2021 10:41am, by B. Cameron Gain
CI/CD / Tools / Sponsored / Contributed
How to Deal with Flaky Tests
30 Mar 2021 11:00am, by Serkan Özal
CI/CD / Open Source / Security
GitLab Open Sources Protocol Fuzzer Community Edition
30 Mar 2021 4:00am, by Steven J. Vaughan-Nichols
CI/CD / DevOps / Sponsored / Contributed
How Continuous Integration and Continuous Delivery (CI/CD) Enhances DevOps
29 Mar 2021 1:50pm, by Saif Gunja
CI/CD / DevOps / Machine Learning
Harness Adds Remote Debugging to its CI Community Edition
24 Mar 2021 2:08pm, by Mike Melanson
CI/CD / Observability / Sponsored / Contributed
Pre-Production Environments: Key Concepts and Best Practices
23 Mar 2021 10:04am, by Ismail Egilmez
CI/CD / Kubernetes / Sponsored / Contributed
How eBay Leverages Kubernetes, Helm Charts and Jenkins Pipelines to Deliver High-Quality Software
22 Mar 2021 7:00am, by Ramit Bedi, Rocky Shang and Zhong Shen
CI/CD / Cloud Native Ecosystem / DevOps
Flux Takes Its Continuous Delivery and Operations to CNCF Incubation
18 Mar 2021 3:00am, by Mike Melanson
CI/CD / DevOps / Sponsored / Contributed
GitOps Use Cases You May Not Have Considered
17 Mar 2021 11:00am, by Ron Powell
CI/CD / DevOps / Security
Sonatype Expands Focus to Code Analysis with MuseDev Addition
17 Mar 2021 8:50am, by Mike Melanson
CI/CD / DevOps / Software Development / Contributed
5 Ways an On-Demand Feature Environment Can Drive Efficiency
10 Mar 2021 11:09am, by Ajaya Loya
CI/CD / DevOps / Sponsored / Contributed
How to Deploy an Application on Friday
10 Mar 2021 7:51am, by Ron Powell
CI/CD / Data Science / Machine Learning
Maiot: Bridging the Path to ML Production
9 Mar 2021 10:47am, by Susan Hall
Pagination Previous Button
1 2 3 4 5 6 7 8 9 10
Pagination Next Button
Architecture
  • Cloud Native
  • Containers
  • Edge/IoT
  • Microservices
  • Networking
  • Serverless
  • Storage
Development
  • Cloud Services
  • Data
  • Development
  • Machine Learning
  • Security
Operations
  • CI/CD
  • Culture
  • DevOps
  • Kubernetes
  • Monitoring
  • Service Mesh
  • Tools
The New Stack
  • Ebooks
  • Podcasts
  • Events
  • Newsletter
  • About / Contact
  • Sponsors
  • Sponsorship
  • Disclosures
  • Contributions

© 2022 The New Stack. All rights reserved.

Privacy Policy. Terms of Use.