SEARCH (ENTER TO SEE ALL RESULTS)
Cancel Search
POPULAR TOPICS
Contributed
sponsored-post-contributed
News
Analysis
The New Stack Makers
Tutorial
Podcast
Feature
Research
Profile
The New Stack Logo
Skip to content
  • Podcasts
  • Events
  • Ebooks
    • DevOps
    • DevSecOps
    • Docker Ecosystem
    • Kubernetes Ecosystem
    • Microservices
    • Observability
    • Security
    • Serverless
    • Storage
    • All Ebooks
  • Newsletter
  • Sponsorship
  • • • •
    • Podcasts
      • TNS @Scale Series
      • TNS Analysts Round Table
      • TNS Context Weekly News
      • TNS Makers Interviews
      • All Podcasts
    • Events
    • Ebooks
      • DevOps
      • DevSecOps
      • Docker Ecosystem
      • Kubernetes Ecosystem
      • Microservices
      • Observability
      • Security
      • Serverless
      • Storage
      • All Ebooks
    • Newsletter
    • Sponsorship
Skip to content
  • Architecture
    • Cloud Native
    • Containers
    • Edge/IoT
    • Microservices
    • Networking
    • Serverless
    • Storage
  • Development
    • Development
    • Cloud Services
    • Data
    • Machine Learning
    • Security
  • Operations
    • CI/CD
    • Culture
    • DevOps
    • Kubernetes
    • Monitoring
    • Service Mesh
    • Tools
Search The New Stack
 

CI/CD

▾ 6 MINUTE READ — CLOSE

Understanding CI/CD Automation
The continuous integration and continuous delivery (CI/CD) method are transforming DevOps. Even if each step of the software development lifecycle can be carried out manually, CI/CD automates the stages in software development and deployment.
Continuous Integration (CI)
Continuous integration is the process of merging code (updates or existing features) with an existing codebase (software tool or product, for example). CI is a development practice where developers merge code in a central repository several times daily.

In CI, each line of code added to the codebase triggers a sequence in a CI/CD pipeline, generating feedback to developers. This process allows improvements to be made quickly and easily.
Continuous Delivery (CD)
CD is the attempt to speed up and automate deployments. An operator can push out multiple deployments in a week across numerous services and know the exact condition of the applications and infrastructure in the course of the deployments.

“Continuous delivery is the natural extension of continuous integration, an approach in which teams ensure that every change to the system is releasable, and release any version with the push of a button. Continuous delivery aims to make releases boring so that we can deliver frequently and get quick feedback on what users care about.” — Thought Works

The Focus of a CI/CD Pipeline
To run a CI/CD pipeline successfully, organizations should outline goals that guide developers’ approaches and processes. While each pipeline is unique, it should reflect some overarching goals.

Here are some results that should be the focus of the pipeline:
Quick Fixes and Improvements in Subsequent Updates
CI/CD automation allows code changes to reflect in end users’ software automatically. CI/CD pipelines should prioritize quick fixes and improvements to existing code to improve software quality and user experience.
Push Button Deployments
Continuous delivery requires a “state” machine, which is not provided by CI tools. CD tools, such as Spinnaker, have the ability to take an environment from one state to the next until it makes it all the way to production. The machine will move the environment, such as Docker containers, through to production in an automated fashion. It will even have the ability to do things such as rollbacks, canary deployments, and scaling instances. This process allows for the agile, push-button, automated deployments that an ideal CD mindset drives towards. Such pipelines are at the core of CD capabilities because they orchestrate a repeatable deployment over stages.
Fast and Frequent Software Releases
One of the higher-level achievements in a DevOps transformation is continuous delivery. Focusing on software releases in a CI/CD pipeline is a cultural shift for companies because it involves organizational change, too. DevOps transformation means building cross-functional teams with common goals, aligning the organization around the architecture and creating a culture of continuous improvement.
The Structure of an Effective CI/CD Workflow
The process for achieving CI/CD goals has been broken down into six stages. The goal is to ensure that new and runnable code is fit for use before it’s sent out to end-users.

Most unique and effective pipelines mirror the following structure:

Each new pipeline run is triggered by a change in the source code repository. An update or variation to the existing code — such as automated workflows or results from a previous pipeline run — begins the CI/CD process.
In this stage, runnable instances of code that could potentially be deployed to end-users are created. This is done through a combination of source code and its dependencies. Code that does not pass this stage indicates a problem with the project’s configuration and should receive immediate attention.
Automated tests are run on the code to determine its accuracy. These tests, created by software developers, are required to meet certain standards. Multiple tests run at this stage would detect bugs or other problems developers do not foresee. The test could take minutes or several hours, depending on its complexity. Code that does not successfully pass this test stage instantly notifies the development team that adjustments need to be made.
After code is tested and considered runnable, it’s delivered to the repository.
Deploy. Once code passes all predefined tests, the runnable code in the repository is deployed into different environments, such as a staging environment for the internal team and a production environment for end-users.
Validation and Compliance. Organizational needs determine what takes place in validation and compliance. For example, image security scanning tools ensure image quality and match them against known vulnerabilities.

The Approach to Cloud Native CI/CD Tools Is Changing
An increasing focus on continuous delivery (CD) has brought new tools and practices that allow teams to produce frequent, fast, and, above all, boring automated releases. Cloud native CI/CD requires a deeper understanding of DevOps practices and how they affect the way organizations deploy and manage workloads using containers, microservices, and serverless functions.

A new approach to continuous integration and continuous delivery (CI/CD) is emerging for cloud native architectures. With cloud native architectures, complexity is shifting away from building and assembly of code towards orchestration of releases. Build tools such as Travis CI and Jenkins are starting to commoditize and become much simpler. As more and more organizations get comfortable with building custom code using containers and other immutable constructs, they spend fewer cycles on building that code and shift into solving the problems of orchestrated releases.
Impact of Kubernetes CI/CD
Kubernetes, the open source container orchestrator, makes CD easier to execute with tools, modularity, and immutable infrastructure. Kubernetes simplifies deployment and monitoring of microservices. It helps define a container deployment and manage instances but leaves it up to the user to automate those deployments into environments.

Here are some proven practices for improving Kubernetes CI/CD:

Implementing Blue-Green Deployment Strategy. Similar to the way we prepare for emergencies, this strategy involves a pattern that creates an additional set of production instances to existing instances for quick switching in case of failure or downtime. The blue represents the staging environment, while the green represents the production environment.
Leveraging Git-Based Workflows. CI/CD pipelines should be activated through GitOps. This ensures that changes and source code in the pipeline are stored in a unified source repository for ease of correction and deployment.
Testing and Scanning New Container Images. Testing and scanning container images every time a new image is created can handle vulnerabilities such as configuration issues introduced with new builds. It also ensures that commands are working properly.

Challenges with the CI/CD Framework
As much as the CI/CD process is evolving, it is not without challenges. Some difficulties faced include:

Version Control. The CI/CD model requires the creation of versions from the source code repository to ensure continuity. Managing these variations can be difficult because of the number of changes made.
Faulty Tests. As new code is written, developers are expected to write multiple tests to determine the accuracy and behavior of products. If the right tests aren’t administered, developers may receive faulty feedback loops, which could affect the end product entirely.
Security Breaches. Concerns have been raised on the security of the CI/CD process in the development, integration, and deployment phases. Software developers are urged to develop security measures alongside the code writing process and not at the end of the cycle.

CI/CD practices are constantly getting refined. Learn more about CI/CD trends, new approaches, and opinions of industry experts through The New Stack articles in this category.


The New Stack Newsletter Sign-Up
A newsletter digest of the week’s most important stories & analyses.
Do you also want to be notified of the following?
We don’t sell or share your email. By continuing, you agree to our Terms of Use and Privacy Policy.
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Containers / Data Science / Kubernetes / Storage
Windocks Brings Containers to Microsoft Windows
1 Mar 2017 12:33pm, by Benjamin Ball
CI/CD / Cloud Native Ecosystem / Containers / Kubernetes / Microservices / Sponsored / Contributed
Adapt or Die: The New Pattern of Software Delivery
23 Feb 2017 1:00am, by Wayne Gibbins
CI/CD / Software Development
GitLab Now Offers Free Static Web Page Hosting
22 Feb 2017 10:00am, by TC Currie
CI/CD / Security / Software Development
Demisto Applies ChatOps to Security Incident Management
20 Feb 2017 9:36am, by Susan Hall
CI/CD / Cloud Native Ecosystem / Containers / DevOps / Kubernetes / Microservices
Kubernetes and the Microservices Hierarchy of Needs
17 Feb 2017 12:00pm, by Bilgin Ibryam
CI/CD / Cloud Native Ecosystem / Containers / Culture / DevOps / Tools
How Operable Built its ChatOps Cog Platform on Docker Images
14 Feb 2017 10:44am, by Jennifer Riggins
CI/CD / Culture / Software Development
To Package a Great User Experience, Start with Your Development Team
9 Feb 2017 1:30pm, by Jennifer Riggins
CI/CD / Data Science
Will Blockchain Change the Way Businesses Operate?
2 Feb 2017 4:00am, by Jennifer Riggins
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Containers / Security
How Twistlock Secures the Enterprise Container
31 Jan 2017 6:00am, by Kiran Oliver
CI/CD / Machine Learning / Software Development
Review: Automation, Joblessness and the Vacuum of Tech Ethics
27 Jan 2017 1:32pm, by Michael Coté
CI/CD / Security / Software Development
What Google Can Teach Us about Security
24 Jan 2017 9:51am, by Maxwell Cooter
API Management / CI/CD / Cloud Native Ecosystem / Containers / Culture / DevOps / Microservices / Software Development
Automation Is the Key for Agile API Documentation
24 Jan 2017 7:58am, by Jennifer Riggins
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Cloud Native Ecosystem / Kubernetes / Sponsored
How Intel’s Snap Telemetry Framework Could Help Data Center Resource Scheduling
12 Jan 2017 10:51am, by Kiran Oliver
CI/CD / Machine Learning / Software Development / Storage
CES 2017: Buddy the Bot and Other Cool Electronics from the Show Floor
6 Jan 2017 12:21pm, by TC Currie
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Tutorials.svg
CI/CD
Set Up a MongoDB Replica Set in Under an Hour Using a Bitnami Package
6 Jan 2017 9:41am, by Joab Jackson
CI/CD / Cloud Native Ecosystem / Containers / DevOps / Microservices / Observability
Make Your Containerized Apps Production-Ready
5 Jan 2017 4:13am, by Vivek Juneja
CI/CD / Culture / DevOps
How Shell Oil Is Taking DevOps and Agile to the Cutting Edge
4 Jan 2017 1:00am, by Jennifer Riggins
CI/CD / Culture / Machine Learning / Open Source / Software Development
The Big Question from 2016: Can We Trust Our Technologies?
1 Jan 2017 12:01am, by David Cassel
CI/CD / Cloud Native Ecosystem / Containers / Kubernetes / Observability / Serverless / Software Development
Our Top 10 Podcasts for 2016
30 Dec 2016 4:36am, by Kiran Oliver
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
CI/CD / Cloud Services / Containers / Security / Storage
SecureAuth Goes Beyond Two-Factor Authentication
26 Dec 2016 8:36am, by Kiran Oliver
API Management / CI/CD / Culture / IoT Edge Computing / Machine Learning / Software Development
How Zuck Built His Jarvis AI Bot from APIs
23 Dec 2016 4:43am, by TC Currie
CI/CD / Cloud Native Ecosystem / Containers / Kubernetes / Software Development / Tools
Wercker Expands CI/CD Platform with Virtual Private Pipelines, Private Cloud Deployments
23 Dec 2016 12:48am, by Joab Jackson
API Management / CI/CD / Containers / Contributed
Reliable Continuous Delivery with Cloudsoft AMP Blueprints
21 Dec 2016 8:04am, by Murdo Aird
CI/CD / Data Science / Open Source
Blockchain Hyperledger Project Generates Interest in the Enterprise
13 Dec 2016 7:09am, by Susan Hall
CI/CD / Containers / Open Source
Sloppy’s Managed Docker-as-a-Service Lets Developers Focus on Code
30 Nov 2016 7:44am, by Susan Hall
CI/CD / Cloud Native Ecosystem / Containers / DevOps / Kubernetes / Microservices / Observability
Right-click Docker: Microsoft’s Ambitious Enterprise Vision for Containers
28 Nov 2016 9:26am, by Joab Jackson
Pagination Previous Button
21 22 23 24 25 26 27 28 29 30
Pagination Next Button
Architecture
  • Cloud Native
  • Containers
  • Edge/IoT
  • Microservices
  • Networking
  • Serverless
  • Storage
Development
  • Cloud Services
  • Data
  • Development
  • Machine Learning
  • Security
Operations
  • CI/CD
  • Culture
  • DevOps
  • Kubernetes
  • Monitoring
  • Service Mesh
  • Tools
The New Stack
  • Ebooks
  • Podcasts
  • Events
  • Newsletter
  • About / Contact
  • Sponsors
  • Sponsorship
  • Disclosures
  • Contributions

© 2022 The New Stack. All rights reserved.

Privacy Policy. Terms of Use.