SEARCH (ENTER TO SEE ALL RESULTS)
Cancel Search
POPULAR TOPICS
Contributed
sponsored-post-contributed
News
Analysis
The New Stack Makers
Tutorial
Podcast
Feature
Research
Profile
The New Stack Logo
Skip to content
  • Podcasts
  • Events
  • Ebooks
    • DevOps
    • DevSecOps
    • Docker Ecosystem
    • Kubernetes Ecosystem
    • Microservices
    • Observability
    • Security
    • Serverless
    • Storage
    • All Ebooks
  • Newsletter
  • Sponsorship
  • • • •
    • Podcasts
      • TNS @Scale Series
      • TNS Analysts Round Table
      • TNS Context Weekly News
      • TNS Makers Interviews
      • All Podcasts
    • Events
    • Ebooks
      • DevOps
      • DevSecOps
      • Docker Ecosystem
      • Kubernetes Ecosystem
      • Microservices
      • Observability
      • Security
      • Serverless
      • Storage
      • All Ebooks
    • Newsletter
    • Sponsorship
Skip to content
  • Architecture
    • Cloud Native
    • Containers
    • Edge/IoT
    • Microservices
    • Networking
    • Serverless
    • Storage
  • Development
    • Development
    • Cloud Services
    • Data
    • Machine Learning
    • Security
  • Operations
    • CI/CD
    • Culture
    • DevOps
    • Kubernetes
    • Monitoring
    • Service Mesh
    • Tools
Search The New Stack
 

Machine Learning

▾ 5 MINUTE READ — CLOSE

The machine learning framework moves beyond the traditional model of computation. Instead of arriving at a definite reproducible answer through a series of calculations, machine learning — a branch of artificial intelligence — works on a series of statistical probabilities to suggest new solutions to a problem. This work is useful for such jobs as designing new materials, medical diagnosis, advanced game graphics and so many other tasks.

What Is Machine Learning?

Machine learning (ML) is part of artificial intelligence (AI) which assists various applications in predicting futuristic outcomes more accurately. Machine learning is being used in many industries and for a variety of purposes from fraud detection to business process automation. Enterprises gain a different view of operational patterns within the organization and trends in customer behavior through machine learning implementation.

Machine Learning Techniques Are Used to Train Algorithms

There are four types of algorithms and several techniques used in machine learning. These types — supervised, unsupervised, semi-supervised, and reinforcement learning — and their respective techniques are examined below:

Supervised Machine Learning

Much of the early success in machine learning has come from supervised learning, where a clearly defined data set is already available for analysis. The algorithm then determines how to arrive at given outputs and inputs. The machine learning algorithm makes predictions by analyzing the data and is corrected by the operator until its predictions are highly accurate.

In supervised machine learning, the algorithm learns through these three techniques:

Classification. The machine learning program determines what categories new observations belong to based on the analysis and observation of the available data sets.

Regression. The machine learning program estimates the relationship between variables where there is one dependent variable and a number of changing variables.

Forecasting. This involves making predictions about the future from new and existing data. It is also used to analyze trends.

Gathering recent momentum has been the Deep Learning technique, which doesn’t require all the intermediate steps that supervised learning does. Instead, the idea is to let the Deep Learning neural nets find the answers on their own.

Machine learning can be used for many different applications and industries, including operations. Find out more about Machine Learning for Operations.

Semi-Supervised Learning

Machine learning algorithms are provided with labeled and unlabeled data. Labeled data provides information about a given data set that helps the algorithm understand what the data is about. Unlabeled data has no descriptions. Through semi-supervised learning, machine learning algorithms learn to label unlabeled data.

Unsupervised Machine Learning

In an unsupervised learning process, the machine learning program is left to observe and analyze large data sets by determining the relationship between variables. There is no operator to make corrections and the algorithm solely addresses data accordingly. As it assesses more data sets, its deductions improve and become refined.

In unsupervised machine learning, the algorithm learns through these techniques:

Clustering. Based on defined criteria, the machine learning program groups similar data from a set by finding a pattern. Clustering is done when each data group needs to be segmented and analyzed.

Dimension reduction. Through predetermined criteria, this process reduces the number of available variables to find the required information.

Reinforcement Machine Learning

In reinforcement machine learning, algorithms are given specific actions, parameters, and results. The algorithm determines the rules and develops different processes for arriving at the given conclusion. The machine learning algorithm arrives at the result through trial and error. Through reinforcement, algorithms learn based on past experiences and adopt the optimal approach determined in new situations.

Top Machine Learning Technologies Are Transforming Ideas

Artificial intelligence technologies are improving outputs in machine learning. Through technology, operators can develop automated machine learning algorithms and achieve more in less time. Some new technologies train machine learning models and others such as Google’s Auto ML Zero — a new kind of automated machine learning — use simple methods to create algorithms that can be adapted to a task at hand.

RapidMiner: an automated ML tool that can significantly reduce the time needed to create predictive models for businesses across many industries with various resources and sizes.

Big ML: technology that automates the machine learning pipeline.

DataRobot: an automated ML tool leveraging regression techniques, neural networks, and gradient boosting to solve multi-class classification problems.

Auto Keras: an open-source software library designed to improve the creation of deep learning techniques

H20: technology that uses its own algorithms to create and optimize pipelines. This is achieved through exhaustive search.

TPOT: AI technology that uses genetic algorithms to optimize machine learning pipelines.

TensorFlow: an open source machine learning framework created by Google that is easy to deploy across various platforms.

Scikit-learn: an open source library developed for machine learning featuring several ML techniques.

Machine Learning Use Cases Are Expanding

Machine learning has many potential applications and is growing rapidly. The exponential growth of data contributes to the expansion and use of machine learning. Not only can machine learning be applied to client-facing applications like product recommendation, customer service, and forecasts, but it can also be used by internal teams to speed up processes and time-consuming tasks.

Here are some machine learning use cases today:

  • Fraud detection
  • Dynamic pricing
  • Product recommendation
  • Email filtering
  • Personalized marketing
  • Process automation
  • Improving sustainability and the environment
  • Proactive help desk operations

At The New Stack, we have focused our coverage of this emerging field mostly around two areas of scalable architecture. We are keeping a close eye on the emerging field of AIOps, where machine learning can influence and drive IT operations. AIOps help to automate the path from development to production, predicting the effect of deployment on production and automatically responding to changes in how the production environment is performing. Companies such as New Relic, OpsRamp, and Moogsoft have all invested heavily in this area.

Another area of machine learning we are covering closely is how Kubernetes and related cloud native technologies can expedite the machine learning lifecycle. Machine learning involves an entire IT cycle of technologies that are very early on in terms of commercialization. Data must be harvested and cleansed, models must be tested, and the most useful approaches must be pressed into production, with a feedback loop of some sort to ensure the models can be updated. Emerging workflows such as Kubeflow and Anaconda can help streamline these processes.

Discover more about machine learning below:

How Machine Learning Works: An Overview

Using Machine Learning to Automate Kubernetes Optimization

Add It Up: How Long Does a Machine Learning Deployment Take?


The New Stack Newsletter Sign-Up
A newsletter digest of the week’s most important stories & analyses.
Do you also want to be notified of the following?
We don’t sell or share your email. By continuing, you agree to our Terms of Use and Privacy Policy.
CI/CD / Machine Learning / Contributed
4 Challenges to Building Scalable AI/ML Pipelines in the Cloud
19 Jun 2018 7:03am, by John Morrell
Machine Learning
IBM ‘BlockDrop’ Research Speeds Neural Networks
18 Jun 2018 1:18pm, by Joab Jackson
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
Kubernetes / Machine Learning
KubeFlow: Manage AI Workflows with Kubernetes
14 Jun 2018 11:52am, by Joab Jackson
CI/CD / DevOps / Machine Learning
Extend Spinnaker Automated Delivery with Machine Learning and Custom Pipeline Logic
5 Jun 2018 1:56pm, by Joab Jackson
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
Machine Learning
Onward OSCON, Portland Town Is Waiting
1 Jun 2018 12:07pm, by TNS Staff
Machine Learning
New Algorithm Will Help Supercomputers Simulate Whole-Brain Neural Connections
31 May 2018 11:00am, by Kimberley Mok
Machine Learning
Off-The-Shelf Hacker: AI Comes to the Maker Market
23 May 2018 12:00pm, by drtorq
Machine Learning
Artificial Intelligence: It Takes a Human Touch
21 May 2018 6:00am, by Susan Hall
Machine Learning
AI Can Now Predict Personality from Eye Movements
17 May 2018 11:34am, by Kimberley Mok
Machine Learning
Google Develops ‘Adversarial Example’ Images that Fool Both Humans and Computers
10 May 2018 7:00am, by Kimberley Mok
Machine Learning
Google DeepMind Psychlab Assesses AI with Cognitive Psychology
26 Apr 2018 11:00am, by Kimberley Mok
Machine Learning
AI Researchers Create Self-Replicating Neural Network
19 Apr 2018 11:00am, by Kimberley Mok
Machine Learning
Veritone Offers AI-as-a-Service for Developers
17 Apr 2018 6:00am, by TC Currie
Machine Learning / Sponsored / Contributed
Easily Move TensorFlow from Dev to Prod with DC/OS, Jupyter, and BeakerX
13 Apr 2018 9:00am, by Chris Gutierrez
Machine Learning
Anaconda’s Python/R Distribution Sets the Stage for Scalable Machine Learning
11 Apr 2018 9:15am, by Joab Jackson
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
Machine Learning
Swim: A Raw Compute Platform that Poses Questions About the Endless Fabrics of Time
5 Apr 2018 12:49pm, by Alex Williams
Machine Learning
OpenAI Algorithm Allows AI to Learn from Its Mistakes
5 Apr 2018 11:00am, by Kimberley Mok
Machine Learning
How Good Is Machine Learning at Understanding Text?
3 Apr 2018 3:00am, by Mary Branscombe
https://cdn.thenewstack.io/media/2016/01/Podcasts-Overlay-Context.svg
Containers / Machine Learning
This Week on The New Stack: Hykes Leaves Docker, Nvidia Joins the Kubernetes Movement
30 Mar 2018 2:31pm, by Libby Clark
Machine Learning
Nvidia Embraces Kubernetes for Scalable Deep Learning
28 Mar 2018 1:27pm, by Joab Jackson
Machine Learning
Nvidia Offers a Data Center Simulator for Training Self-Driving Automobiles
27 Mar 2018 11:07am, by Joab Jackson
Machine Learning / Software Development
This Week in Programming: Big Blue’s AI Play for the Enterprise
24 Mar 2018 6:00am, by Mike Melanson
Machine Learning / Contributed
Building Blocks for AI: Mutual Information and the Pearson Correlation
23 Mar 2018 8:58am, by Ebrahim Safavi
https://cdn.thenewstack.io/media/2016/01/PodcastBrandingOverlay_TNS_Makers.svg
Machine Learning
Azure CTO: Open Source Is Key to Machine Learning in the Cloud, or on the Edge
22 Mar 2018 2:41pm, by Mary Branscombe
Machine Learning
AI Algorithm with ‘Social Skills’ Cooperates Better Than Humans
22 Mar 2018 11:00am, by Kimberley Mok
Machine Learning / Contributed
How Deep Learning Supercharges Natural Language Processing
20 Mar 2018 3:00am, by Jacob Perkins
Pagination Previous Button
21 22 23 24 25 26 27 28 29 30
Pagination Next Button
Architecture
  • Cloud Native
  • Containers
  • Edge/IoT
  • Microservices
  • Networking
  • Serverless
  • Storage
Development
  • Cloud Services
  • Data
  • Development
  • Machine Learning
  • Security
Operations
  • CI/CD
  • Culture
  • DevOps
  • Kubernetes
  • Monitoring
  • Service Mesh
  • Tools
The New Stack
  • Ebooks
  • Podcasts
  • Events
  • Newsletter
  • About / Contact
  • Sponsors
  • Sponsorship
  • Disclosures
  • Contributions

© 2022 The New Stack. All rights reserved.

Privacy Policy. Terms of Use.