Culture / Data

Companies May Have Unrealistic Expectations of Their Data Infrastructure

22 Apr 2021 7:47am, by

Data and analytics leaders may be overestimating their companies’ ability to benefit from the next round of investments in data infrastructure technology. A survey conducted on behalf of data catalog vendor Alation asked leaders at companies with more than 2,500 employees for grades about their corporate data culture. Two-thirds believe their company’s data culture ranks in the top tier among its peers. In reality, most are falling short getting data practices and technologies adopted throughout their companies. Outside the one-third of companies that actually fall in the top tier, 87% of the remaining company’s self-assessments were overly optimistic as compared to the actual progress they’ve made.

The report measures “data culture” in terms of the ability to find data (search and discovery), analyze the data (literacy) and govern it appropriately (governance). For a majority of the study, at least half of their companies’ departments have adopted each of these capabilities. However, fewer than 15% say that all their departments are capable in one of these disciplines.

It may be unrealistic to expect all departments to gain these capabilities, but the ability to discover, analyze and handle data has become so important that it is hard to compartmentalize its expertise. Data catalog technologies need a major upgrade, but staff also should be given additional training and responsibilities so they do not need to rely on data teams managed in far away departments. Analyzing and understanding data to make better decisions is essential for data scientists but also for just about everyone else in the modern world.

Almost half (49%) of the study is fostering the management of data governance at the point of data use as a way to foster data culture. These efforts are akin to security awareness training for employees. It takes a lot of time and staff effort, but decentralized approaches can be very effective. The companies that distinguish themselves as having adopted a data culture and technology across their ranks are the ones that are purposefully working on a collaboration. According to the study, 58% of the top-tier data culture companies are more increasing collaboration between business and the data and analytics team, which is twice as many as companies in the lowest tier (29%).

Feature image: The Open Data Institute.

Participate in The New Stack surveys and be the first to receive the results of our original research.