SEARCH (ENTER TO SEE ALL RESULTS)
Cancel Search
POPULAR TOPICS
Contributed
sponsored-post-contributed
News
Analysis
The New Stack Makers
Tutorial
Podcast
Feature
Research
Profile
The New Stack Logo
Skip to content
  • Podcasts
  • Events
  • Ebooks
    • DevOps
    • DevSecOps
    • Docker Ecosystem
    • Kubernetes Ecosystem
    • Microservices
    • Observability
    • Security
    • Serverless
    • Storage
    • All Ebooks
  • Newsletter
  • Sponsorship
  • • • •
    • Podcasts
      • TNS @Scale Series
      • TNS Analysts Round Table
      • TNS Context Weekly News
      • TNS Makers Interviews
      • All Podcasts
    • Events
    • Ebooks
      • DevOps
      • DevSecOps
      • Docker Ecosystem
      • Kubernetes Ecosystem
      • Microservices
      • Observability
      • Security
      • Serverless
      • Storage
      • All Ebooks
    • Newsletter
    • Sponsorship
Skip to content
  • Architecture
    • Cloud Native
    • Containers
    • Edge/IoT
    • Microservices
    • Networking
    • Serverless
    • Storage
  • Development
    • Development
    • Cloud Services
    • Data
    • Machine Learning
    • Security
  • Operations
    • CI/CD
    • Culture
    • DevOps
    • Kubernetes
    • Monitoring
    • Service Mesh
    • Tools
Search The New Stack
 

CI/CD

▾ 6 MINUTE READ — CLOSE

Understanding CI/CD Automation
The continuous integration and continuous delivery (CI/CD) method are transforming DevOps. Even if each step of the software development lifecycle can be carried out manually, CI/CD automates the stages in software development and deployment.
Continuous Integration (CI)
Continuous integration is the process of merging code (updates or existing features) with an existing codebase (software tool or product, for example). CI is a development practice where developers merge code in a central repository several times daily.

In CI, each line of code added to the codebase triggers a sequence in a CI/CD pipeline, generating feedback to developers. This process allows improvements to be made quickly and easily.
Continuous Delivery (CD)
CD is the attempt to speed up and automate deployments. An operator can push out multiple deployments in a week across numerous services and know the exact condition of the applications and infrastructure in the course of the deployments.

“Continuous delivery is the natural extension of continuous integration, an approach in which teams ensure that every change to the system is releasable, and release any version with the push of a button. Continuous delivery aims to make releases boring so that we can deliver frequently and get quick feedback on what users care about.” — Thought Works

The Focus of a CI/CD Pipeline
To run a CI/CD pipeline successfully, organizations should outline goals that guide developers’ approaches and processes. While each pipeline is unique, it should reflect some overarching goals.

Here are some results that should be the focus of the pipeline:
Quick Fixes and Improvements in Subsequent Updates
CI/CD automation allows code changes to reflect in end users’ software automatically. CI/CD pipelines should prioritize quick fixes and improvements to existing code to improve software quality and user experience.
Push Button Deployments
Continuous delivery requires a “state” machine, which is not provided by CI tools. CD tools, such as Spinnaker, have the ability to take an environment from one state to the next until it makes it all the way to production. The machine will move the environment, such as Docker containers, through to production in an automated fashion. It will even have the ability to do things such as rollbacks, canary deployments, and scaling instances. This process allows for the agile, push-button, automated deployments that an ideal CD mindset drives towards. Such pipelines are at the core of CD capabilities because they orchestrate a repeatable deployment over stages.
Fast and Frequent Software Releases
One of the higher-level achievements in a DevOps transformation is continuous delivery. Focusing on software releases in a CI/CD pipeline is a cultural shift for companies because it involves organizational change, too. DevOps transformation means building cross-functional teams with common goals, aligning the organization around the architecture and creating a culture of continuous improvement.
The Structure of an Effective CI/CD Workflow
The process for achieving CI/CD goals has been broken down into six stages. The goal is to ensure that new and runnable code is fit for use before it’s sent out to end-users.

Most unique and effective pipelines mirror the following structure:

Each new pipeline run is triggered by a change in the source code repository. An update or variation to the existing code — such as automated workflows or results from a previous pipeline run — begins the CI/CD process.
In this stage, runnable instances of code that could potentially be deployed to end-users are created. This is done through a combination of source code and its dependencies. Code that does not pass this stage indicates a problem with the project’s configuration and should receive immediate attention.
Automated tests are run on the code to determine its accuracy. These tests, created by software developers, are required to meet certain standards. Multiple tests run at this stage would detect bugs or other problems developers do not foresee. The test could take minutes or several hours, depending on its complexity. Code that does not successfully pass this test stage instantly notifies the development team that adjustments need to be made.
After code is tested and considered runnable, it’s delivered to the repository.
Deploy. Once code passes all predefined tests, the runnable code in the repository is deployed into different environments, such as a staging environment for the internal team and a production environment for end-users.
Validation and Compliance. Organizational needs determine what takes place in validation and compliance. For example, image security scanning tools ensure image quality and match them against known vulnerabilities.

The Approach to Cloud Native CI/CD Tools Is Changing
An increasing focus on continuous delivery (CD) has brought new tools and practices that allow teams to produce frequent, fast, and, above all, boring automated releases. Cloud native CI/CD requires a deeper understanding of DevOps practices and how they affect the way organizations deploy and manage workloads using containers, microservices, and serverless functions.

A new approach to continuous integration and continuous delivery (CI/CD) is emerging for cloud native architectures. With cloud native architectures, complexity is shifting away from building and assembly of code towards orchestration of releases. Build tools such as Travis CI and Jenkins are starting to commoditize and become much simpler. As more and more organizations get comfortable with building custom code using containers and other immutable constructs, they spend fewer cycles on building that code and shift into solving the problems of orchestrated releases.
Impact of Kubernetes CI/CD
Kubernetes, the open source container orchestrator, makes CD easier to execute with tools, modularity, and immutable infrastructure. Kubernetes simplifies deployment and monitoring of microservices. It helps define a container deployment and manage instances but leaves it up to the user to automate those deployments into environments.

Here are some proven practices for improving Kubernetes CI/CD:

Implementing Blue-Green Deployment Strategy. Similar to the way we prepare for emergencies, this strategy involves a pattern that creates an additional set of production instances to existing instances for quick switching in case of failure or downtime. The blue represents the staging environment, while the green represents the production environment.
Leveraging Git-Based Workflows. CI/CD pipelines should be activated through GitOps. This ensures that changes and source code in the pipeline are stored in a unified source repository for ease of correction and deployment.
Testing and Scanning New Container Images. Testing and scanning container images every time a new image is created can handle vulnerabilities such as configuration issues introduced with new builds. It also ensures that commands are working properly.

Challenges with the CI/CD Framework
As much as the CI/CD process is evolving, it is not without challenges. Some difficulties faced include:

Version Control. The CI/CD model requires the creation of versions from the source code repository to ensure continuity. Managing these variations can be difficult because of the number of changes made.
Faulty Tests. As new code is written, developers are expected to write multiple tests to determine the accuracy and behavior of products. If the right tests aren’t administered, developers may receive faulty feedback loops, which could affect the end product entirely.
Security Breaches. Concerns have been raised on the security of the CI/CD process in the development, integration, and deployment phases. Software developers are urged to develop security measures alongside the code writing process and not at the end of the cycle.

CI/CD practices are constantly getting refined. Learn more about CI/CD trends, new approaches, and opinions of industry experts through The New Stack articles in this category.


The New Stack Newsletter Sign-Up
A newsletter digest of the week’s most important stories & analyses.
Do you also want to be notified of the following?
We don’t sell or share your email. By continuing, you agree to our Terms of Use and Privacy Policy.
https://cdn.thenewstack.io/media/2016/01/Podcasts-Overlay-Context.svg
CI/CD
Context: Continuous Verification and Site Reliability Engineering
26 Jul 2019 6:00pm, by TNS Staff
CI/CD / DevOps / Sponsored / Contributed
Continuous Verification: The Missing Link to Fully Automate Your Pipeline
22 Jul 2019 6:00am, by Dan Illson and Bahubali Bill Shetti
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Cloud Native Ecosystem / Tools / Sponsored
The Continuous Delivery Foundation Gets a Reality Check
10 Jul 2019 5:00pm, by B. Cameron Gain
https://cdn.thenewstack.io/media/2016/01/Podcasts-Overlay-Context.svg
CI/CD / Cloud Services / Serverless / Sponsored
Context: Selecting Managed Services on AWS
1 Jul 2019 10:19am, by TNS Staff
CI/CD / Machine Learning / Sponsored / Contributed
Harness Community Edition: How Not to Get Left Behind in the Continuous Delivery Race
1 Jul 2019 10:13am, by Ravi Lachhman
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Cloud Native Ecosystem / Sponsored
How to Make Kafka Cloud Native
26 Jun 2019 5:00pm, by TC Currie
CI/CD / Software Development / Sponsored
Artifactory at Scale at IBM Cloud
25 Jun 2019 9:38am, by Susan Hall
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / DevOps / Sponsored
Why Your Organization Cannot Live on Git Alone
21 Jun 2019 11:37am, by B. Cameron Gain
CI/CD / DevOps / Sponsored
JFrog Pipelines: Easier, Unified Software Delivery
21 Jun 2019 10:00am, by Susan Hall
CI/CD / DevOps / Sponsored
JFrog Debuts Pipelines, Designed to Provide End-to-End DevOps Automation
18 Jun 2019 3:39pm, by Alex Williams and Joab Jackson
CI/CD / Cloud Native Ecosystem
The CD Foundation Finds a Challenging Environment in Continuous Delivery
17 Jun 2019 12:03pm, by B. Cameron Gain
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Containers
Container Security, Unverified Images and Docker Vulnerabilities
12 Jun 2019 12:27pm, by Jennifer Riggins
CI/CD / Microservices / Open Source
IBM Open Sources Razee, a Pull-Based Kubernetes Continuous Delivery Tool
10 Jun 2019 11:59am, by Mike Melanson
CI/CD / Security / Sponsored / Contributed
The Biggest Security Risks Lurking in Your CI/CD Pipeline
5 Jun 2019 2:16pm, by Twain Taylor
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / DevOps / Security / Sponsored
How One of The Netherlands’ Largest Banks Came to CI/CD
4 Jun 2019 5:00pm, by B. Cameron Gain
CI/CD / DevOps / Sponsored / Contributed
Why You Must Reinvent Testing for Agile and DevOps
3 Jun 2019 11:20am, by Wayne Ariola
CI/CD / Contributed
The Bullwhip Effect in Continuous Delivery: When Good Features Go Bad
28 May 2019 11:25am, by Jake Sorofman
CI/CD / Tools
New Chef Features Focus on ‘Effortless Infrastructure’
22 May 2019 8:20am, by Susan Hall
CI/CD / Observability / Contributed
Surviving Peak Online Traffic Events
21 May 2019 3:00pm, by Dave Karow
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_AtScale.svg
CI/CD / Cloud Native Ecosystem / Open Source / Sponsored
Can an Open Source Foundation Fix Continuous Delivery Pipelines?
16 May 2019 5:00pm, by B. Cameron Gain
CI/CD / Cloud Native Ecosystem / Technology
Red Hat Enterprise Linux 8 Addresses the Hybrid, Multicloud Future
7 May 2019 6:00am, by Mike Melanson
CI/CD / Tools
Puppet Enterprise 2019.1: Easier and More Reliable
2 May 2019 8:26am, by B. Cameron Gain
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Technology / Tools / Sponsored
The Evolution of APIs: Past and Present
22 Apr 2019 5:00pm, by B. Cameron Gain
CI/CD / Data Science / Contributed
Solved! Kubernetes Operators for Clustered Database Deployments
22 Apr 2019 12:00pm, by Ravi Mayuram
CI/CD
CloudBees, Atos Partner to Offer a CI/CD Stack for Google Cloud
10 Apr 2019 11:07am, by B. Cameron Gain
CI/CD
Gremlin-Spinnaker Integration for Automating Chaos Engineering
9 Apr 2019 10:00am, by Susan Hall
Pagination Previous Button
11 12 13 14 15 16 17 18 19 20
Pagination Next Button
Architecture
  • Cloud Native
  • Containers
  • Edge/IoT
  • Microservices
  • Networking
  • Serverless
  • Storage
Development
  • Cloud Services
  • Data
  • Development
  • Machine Learning
  • Security
Operations
  • CI/CD
  • Culture
  • DevOps
  • Kubernetes
  • Monitoring
  • Service Mesh
  • Tools
The New Stack
  • Ebooks
  • Podcasts
  • Events
  • Newsletter
  • About / Contact
  • Sponsors
  • Sponsorship
  • Disclosures
  • Contributions

© 2022 The New Stack. All rights reserved.

Privacy Policy. Terms of Use.