New Relic Changes Business Model, Open Sources Agents and Instrumentation
Observability platform provider New Relic is changing much of its proprietary business model as it open sources a number of agents in its product catalog. In what New Relic executives described as adjusting to a “sea change” in open source adoption, the company has begun to make available as open source on GitHub its agents and instrumentation integrations with public cloud services and other projects.
While the company will continue to sell its New Relic One platform as a service, New Relic will offer its agents, integrations, software development kits, command-line interfaces and its “custom visualizations“ in the New Relic One catalog. New Relic has made available the code for its C, Go, .NET, Node, Python and Ruby agents. Java agents are scheduled to become available in September, followed by PHP in October, New Relic said.
“These agents are all in the open,” Chief Product Officer Bill Staples — who was instrumental in Microsoft’s adoption of open source and its use for Azure — told The New Stack.
“We’re taking contributions from the community and we’re publishing our roadmap,” Staples said. “We’re 100% committed to the open source philosophy.”
In parallel, New Relic will contribute code and financial resources for the Cloud Native Computing Foundation’s (CNCF) OpenTelemetry standard, in hope of helping to standardize instrumentation, which is often seen as lacking in cloud native infrastructure management. New Relic representatives said New Relic is also actively contributing to and supporting Prometheus standards for instrumentation and other telemetry projects, including Dropwizard, Kamon, Micrometer, StatsD and Telegraf, as well as related tools, such as Grafana.
In this way, an organization might take New Relic’s open source code and use it for its own own purposes, while also contributing changes to the project. Under the terms of the license, they can use the agent libraries for their applications. Once the application is running, the telemetry diagnostic information that is emitted essentially “can be pointed at any number of open source backends or commercial backends,” such as those New Relic provides, Staples said.
For cloud deployments, for example, a New Relic customer might rely on New Relic’s commercial services for networking storage and visualization analytics, while also using New Relic’s open source agent for its application and code.
New Relic’s move can be seen as a way to “create customer stickiness,” Clive Longbottom, an analyst for Clive Longbottom and Associates, said. “If New Relic can get others to create modules and integrations using the SDKs, then they extend their reach at little risk to themselves,” Longbottom said. “If they can get a good following, it means that the explosion of new software, such as in the IoT and AI areas can be covered through the open source community, rather than New Relic trying to do everything. Overall, a clever enough move — as long as New Relic successfully monetizes its customer base.”
New Relic is largely responding to both a shift in open source adoption, as well as the need for standardization, especially for standardization. In a cloud native world, for example, “differentiation in observability no longer lies in proprietary instrumentation, but in the scalability of the overall platform architecture,” Torsten Volk, an analyst for Enterprise Management Associates (EMA), told The New Stack.
“The entire principle of Kubernetes-based microservices focuses on applications running anywhere, without restrictions. As a consequence, proprietary instrumentation for proprietary application stacks is becoming less viable,” Volk said. “In a nutshell, enterprises are selecting observability solutions that best support their cloud native scale-out architecture.”
Agents are thus becoming a commodity. “It makes sense to open source them and throw your weight behind the OpenTelemetry standard,” Volk said. “New Relic can then focus on differentiating through its backend platform, which is where the AI-driven magic really lies.”
Docker’s past difficulties serve as a case study in what to avoid, Volk said.
“As the fall of the Docker company has shown, if you hang on for too long to proprietary solutions, the market will punish you,” Volk said. “Therefore, this step is simply reflecting the reality of today’s market that will penalize any solution that prevents or slows down the implementation of true scale-out software platforms.”
“In a scale out world, proprietary instrumentation will be viewed as seaweed on the anchor of digital transformation”– Torsten Volk, Enterprise Management Associates (EMA)
However, the shift of instrumentation becoming more commoditized is a positive change as these critical tools become more standardized and are applied to highly complex mixes of multicloud and on premises legacy environments DevOps teams typically manage. Instrumentation thus remains “very important, as 70-80% of applications are still unmodernized and rely on traditional monitoring,” Volk said. “For New Relic to open up their large vault of complete and comprehensive agents will tempt DevOps teams to try out a few of them and if they are successful, they may end up putting their weight behind selecting New Relic as their new observability platform vendor. At the very least, this move will make New Relic a relevant player in the cloud native space, instead of being regarded as “the guys whose software is too expensive for Kubernetes.”
As proof that New Relic’s shift helps to make the case that open source is the model of the future for software providers, the OpenTelemetry project alone, and New Relic’s support for it, help to demonstrate how the open source model is highly applicable to large-scale framework applications.
“The more vendors focus on the success of OpenTelemetry instead of developing their proprietary solutions, the more likely customers will be to standardize their organization on the use of OpenTelemetry,” Volk said. “The entire idea of open source is based on this belief that multiple vendors collaborating on the development of commodity products, such as monitoring agents, customers will have more choice and vendors can spend their resources on further developing their own “secret sauce” instead of creating the nth monitoring agent for MySQL or Red Hat Enterprise Linux.”
Still, New Relic’s open source project also represents a gamble, in many respects, and can arguably be seen as a “radical” move, Volk said.
“Radical is needed for credibility. In a world where more and more enterprises prefer open source software, you need to show that you are all in at an early stage. Being “all in” means more than just sharing your source code, as open source software only has a chance of mass adoption when multiple vendors throw their weight behind a project,” Volk said. “Therefore, for New Relic to throw their weight behind OpenTelemetry and looking for future differentiation further up the stack, makes a ton of sense. In a scale-out world, proprietary instrumentation will be viewed as seaweed on the anchor of digital transformation.”