SEARCH (ENTER TO SEE ALL RESULTS)
Cancel Search
POPULAR TOPICS
Contributed
sponsored-post-contributed
News
Analysis
The New Stack Makers
Tutorial
Podcast
Feature
Research
Profile
The New Stack Logo
Skip to content
  • Podcasts
  • Events
  • Ebooks
    • DevOps
    • DevSecOps
    • Docker Ecosystem
    • Kubernetes Ecosystem
    • Microservices
    • Observability
    • Security
    • Serverless
    • Storage
    • All Ebooks
  • Newsletter
  • Sponsorship
  • • • •
    • Podcasts
      • TNS @Scale Series
      • TNS Analysts Round Table
      • TNS Context Weekly News
      • TNS Makers Interviews
      • All Podcasts
    • Events
    • Ebooks
      • DevOps
      • DevSecOps
      • Docker Ecosystem
      • Kubernetes Ecosystem
      • Microservices
      • Observability
      • Security
      • Serverless
      • Storage
      • All Ebooks
    • Newsletter
    • Sponsorship
Skip to content
  • Architecture
    • Cloud Native
    • Containers
    • Edge/IoT
    • Microservices
    • Networking
    • Serverless
    • Storage
  • Development
    • Development
    • Cloud Services
    • Data
    • Machine Learning
    • Security
  • Operations
    • CI/CD
    • Culture
    • DevOps
    • Kubernetes
    • Monitoring
    • Service Mesh
    • Tools
Search The New Stack
 

Machine Learning

▾ 4 MINUTE READ — CLOSE

The machine learning framework moves beyond the traditional model of computation. Instead of arriving at a definite reproducible answer through a series of calculations, machine learning — a branch of artificial intelligence — works on a series of statistical probabilities to suggest new solutions to a problem. This work is useful for such jobs as designing new materials, medical diagnosis, advanced game graphics and so many other tasks.
Machine Learning Techniques Are Used to Train Algorithms
There are four types of algorithms and several techniques used in machine learning. These types — supervised, unsupervised, semi-supervised, and reinforcement learning — and their respective techniques are examined below:
Supervised Machine Learning
Much of the early success in machine learning has come from supervised learning, where a clearly defined data set is already available for analysis. The algorithm then determines how to arrive at given outputs and inputs. The machine learning algorithm makes predictions by analyzing the data and is corrected by the operator until its predictions are highly accurate.

In supervised machine learning, the algorithm learns through these three techniques:

Classification. The machine learning program determines what categories new observations belong to based on the analysis and observation of the available data sets.
Regression. The machine learning program estimates the relationship between variables where there is one dependent variable and a number of changing variables.
Forecasting. This involves making predictions about the future from new and existing data. It is also used to analyze trends.

Gathering recent momentum has been the Deep Learning technique, which doesn’t require all the intermediate steps that supervised learning does. Instead, the idea is to let the Deep Learning neural nets find the answers on their own.
Semi-Supervised Learning
Machine learning algorithms are provided with labeled and unlabeled data. Labeled data provides information about a given data set that helps the algorithm understand what the data is about. Unlabeled data has no descriptions. Through semi-supervised learning, machine learning algorithms learn to label unlabeled data.
Unsupervised Machine Learning
In an unsupervised learning process, the machine learning program is left to observe and analyze large data sets by determining the relationship between variables. There is no operator to make corrections and the algorithm solely addresses data accordingly. As it assesses more data sets, its deductions improve and become refined.

In unsupervised machine learning, the algorithm learns through these techniques:

Clustering. Based on defined criteria, the machine learning program groups similar data from a set by finding a pattern. Clustering is done when each data group needs to be segmented and analyzed.
Dimension reduction. Through predetermined criteria, this process reduces the number of available variables to find the required information.

Reinforcement Machine Learning
In reinforcement machine learning, algorithms are given specific actions, parameters, and results. The algorithm determines the rules and develops different processes for arriving at the given conclusion. The machine learning algorithm arrives at the result through trial and error. Through reinforcement, algorithms learn based on past experiences and adopt the optimal approach determined in new situations.
Top Machine Learning Technologies Are Transforming Ideas
Artificial intelligence technologies are improving outputs in machine learning. Through technology, operators can develop automated machine learning algorithms and achieve more in less time. Some new technologies train machine learning models and others such as Google’s Auto ML Zero — a new kind of automated machine learning — use simple methods to create algorithms that can be adapted to a task at hand.

RapidMiner: an automated ML tool that can significantly reduce the time needed to create predictive models for businesses across many industries with various resources and sizes.
Big ML: technology that automates the machine learning pipeline.
DataRobot: an automated ML tool leveraging regression techniques, neural networks, and gradient boosting to solve multiclass classification problems.
Auto Keras: an open-source software library designed to improve the creation of deep learning techniques
H20: technology that uses its own algorithms to create and optimize pipelines. This is achieved through exhaustive search.
TPOT: AI technology that uses genetic algorithms to optimize machine learning pipelines.
TensorFlow: an open source machine learning framework created by Google that is easy to deploy across various platforms.
Scikit-learn: an open source library developed for machine learning featuring several ML techniques.

Machine Learning Use Cases Are Expanding
Machine learning has many potential applications and is growing rapidly. The exponential growth of data contributes to the expansion and use of machine learning. Not only can machine learning be applied to client-facing applications like product recommendation, customer service, and forecasts, but it can also be used by internal teams to speed up processes and time-consuming tasks.

Here are some machine learning use cases today:

Fraud detection
Dynamic pricing
Product recommendation
Email filtering
Personalized marketing
Process automation
Improving sustainability and the environment
Proactive help desk operations

At The New Stack, we have focused our coverage of this emerging field mostly around two areas of scalable architecture. We are keeping a close eye on the emerging field of AIOps, where machine learning can influence and drive IT operations. AIOps help to automate the path from development to production, predicting the effect of deployment on production and automatically responding to changes in how the production environment is performing. Companies such as New Relic, OpsRamp, and Moogsoft have all invested heavily in this area.

Another area of machine learning we are covering closely is how Kubernetes and related cloud native technologies can expedite the machine learning lifecycle. Machine learning involves an entire IT cycle of technologies that are very early on in terms of commercialization. Data must be harvested and cleansed, models must be tested, and the most useful approaches must be pressed into production, with a feedback loop of some sort to ensure the models can be updated. Emerging workflows such as Kubeflow and Anaconda can help streamline these processes.

Read our articles in this category to learn more about machine learning.


The New Stack Newsletter Sign-Up
A newsletter digest of the week’s most important stories & analyses.
Do you also want to be notified of the following?
We don’t sell or share your email. By continuing, you agree to our Terms of Use and Privacy Policy.
Data Science / Kubernetes / Machine Learning / Sponsored / Contributed
How Open Data Hub Speeds AI Development and Fixed a Kubernetes Bottleneck
25 Feb 2021 7:21am, by Alex Handy
Culture / Data Science / Machine Learning
Big Questions for the Ethical Use of AI
24 Feb 2021 12:00pm, by Kimberley Mok
Data Science / Machine Learning / Software Development
The Ultimate Guide to Machine Learning Frameworks
24 Feb 2021 10:28am, by Janakiram MSV
Data Science / Machine Learning / Sponsored / Contributed
Rudderstack: How Pachyderm Pipelines Help Parse Customer Event Data
19 Feb 2021 12:00pm, by Amey Varangaonkar
Machine Learning
Tutorial: Install Kubernetes and Kubeflow on a GPU Host with NVIDIA DeepOps
19 Feb 2021 8:00am, by Janakiram MSV
Data Science / Machine Learning / Contributed
5 Ways to Make the Most of Your Data ‘Lakehouse’
18 Feb 2021 11:12am, by Chris D’Agostino
Culture / Data Science / Machine Learning / Contributed
Transparent AI: Explainable and Trainable Artificial Intelligence
17 Feb 2021 11:00am, by Adam Frank
Data Science / Machine Learning
Pinecone: A Vector Database for Machine Learning Applications
15 Feb 2021 1:37pm, by Susan Hall
Data Science / Machine Learning / Sponsored / Contributed
The Future of Data Engineering
12 Feb 2021 11:00am, by Soumyadeb Mitra and Eric Dodds
Kubernetes / Machine Learning
Kubeflow: Where Machine Learning Meets the Modern Infrastructure
12 Feb 2021 6:00am, by Janakiram MSV
Data Science / Machine Learning / Contributed
Defining AI: Add Machine Learning into Your Production Environment
12 Feb 2021 3:00am, by Trevor Pott
Data Science / Machine Learning / Software Development
Explore and Visualize Data the Apache Superset Way
11 Feb 2021 12:00pm, by Susan Hall
Data Science / DevOps / Machine Learning
Creating Machine Learning Models Takes too Much Time
11 Feb 2021 9:47am, by Lawrence E Hecht
Data Science / DevOps / Machine Learning / Sponsored / Contributed
Delivering Production-Grade Machine Learning Outcomes with MLOps
11 Feb 2021 8:00am, by Nick Heudecker
DevOps / Machine Learning / Software Development / Sponsored / Contributed
How an Imbalanced Test Automation Strategy Hurts Business Agility
11 Feb 2021 3:00am, by Jason English
Culture / Machine Learning
Alphabet Workers Union Tests Tech Industry Appetite for Unionization
8 Feb 2021 3:00am, by Jennifer Riggins
Intel Machine Learning Day banner
Machine Learning / Software Development / Sponsored
A Day with Intel on Hacking and Scaling Machine Learning with Open Source
4 Feb 2021 4:35pm, by Alex Williams
Data Science / Machine Learning / Software Development
Iterative.ai: Git-Based Machine Learning Tools for ML Engineers
4 Feb 2021 9:10am, by Susan Hall
Data Science / DevOps / Machine Learning / Contributed
2021 Will Be the Year of Enterprise Machine Learning
3 Feb 2021 9:00am, by Diego Oppenheimer
DevOps / Machine Learning / Security / Sponsored / Contributed
AIOps Isn’t Just a Pipe Dream, but the Tools You Use May Be
26 Jan 2021 9:33am, by Michael Cucchi
Machine Learning / Software Development
Avocado Chairs at the Intersection of Human Language and Neural Networks
22 Jan 2021 10:00am, by Kimberley Mok
Culture / DevOps / Machine Learning / Contributed
Meet the Star Member of the IT Team: The AI Assistant
15 Jan 2021 1:07pm, by Bob Friday
Cloud Services / Data Science / Machine Learning
Software Engineers Use Spreadsheets; Data Engineers Use the Cloud
14 Jan 2021 1:00pm, by Lawrence E Hecht
CI/CD / Machine Learning / Sponsored / Contributed
4 Ways AI Will Shape CI/CD in 2021
11 Jan 2021 8:30am, by Tiffany Jachja
IoT Edge Computing / Machine Learning / Software Development
MIT Machine Learning Uses ‘Graph Grammar’ to Automate and Optimize Robot Design
6 Jan 2021 12:20pm, by Kimberley Mok
Data Science / Machine Learning / Sponsored / Contributed
Data Engineer Emerges as the Critical Role for Data Success
5 Jan 2021 7:00am, by Nick Heudecker
Pagination Previous Button
1 2 3 4 5 6 7 8 9 10
Pagination Next Button
Architecture
  • Cloud Native
  • Containers
  • Edge/IoT
  • Microservices
  • Networking
  • Serverless
  • Storage
Development
  • Cloud Services
  • Data
  • Development
  • Machine Learning
  • Security
Operations
  • CI/CD
  • Culture
  • DevOps
  • Kubernetes
  • Monitoring
  • Service Mesh
  • Tools
The New Stack
  • Ebooks
  • Podcasts
  • Events
  • Newsletter
  • About / Contact
  • Sponsors
  • Sponsorship
  • Disclosures
  • Contributions

© 2022 The New Stack. All rights reserved.

Privacy Policy. Terms of Use.