When developing applications at scale, monitoring and gaining visibility into their performance is crucial. As the amount of data generated by these applications continues to grow, organizations may find themselves struggling with how to analyze it in an efficient manner. With a monitoring solution in place coupled with proper analytics, today’s enterprises can gain not only valuable insights into their company data but into the overall performance of their infrastructure from end to end.
In this episode of The New Stack Makers embedded below, we explore how the data generated by today’s applications can be improved with proper analytics and processes, how SignalFX is addressing the issues surrounding working with data at scale, and how having the right insights through application monitoring can empower today’s enterprise. The New Stack founder Alex Williams spoke with SignalFX software engineer Rajesh Raman to hear his thoughts and to discuss his panel from Gluecon 2016, which has also been uploaded below.
Without analytics, even the most powerful monitoring solution will not be able to work to its full potential. Raman noted that with the large amounts of fast-moving data being churned by today’s applications, there is often no efficient way for teams to process thousands of data streams across their infrastructure in real-time.
SignalFX offers a monitoring and analytics platform that allows enterprises to stream their data, monitor their application performance, and get alerts as to their overall service health. Having recently released a live beta of what the company is hailing as, ‘Streaming for the masses’ with its SignalFlow 2.0 API, SignalFX allows any user to perform both historical and real-time streaming on their data across their entire infrastructure.
“People who are monitoring and running infrastructures need to have insight into that infrastructure, and how their applications are running. This requires analytics because you’re not going to be able to get inside them, and into monitoring individual nodes. We believe that modern monitoring is an analytics problem,” said Raman.
“You need analytic systems that can ingest this data in real time, and provide you insight on what the system is doing so you can make the right decisions going forward. The need to get insight is one of the major drivers of analytics, where you can’t look at one thousand time points to get insights, and then reduce that data down to one or two time series so you can see what’s actually happening,” Raman explained.
Raman later went on to note that one of the biggest challenges facing monitoring and analytics today is not only how to work with data that comes from a variety of distributed teams and applications, but changing the ways in which developers think about the future, “One of the big challenges right now is that these parameters are not fixed in time. Policy has to continuously evolve, and adapt to changing conditions,” he said.
Feature image: SignalFX.