Data is divisive. From project failure to escalating costs, management demands for better information are simply not being met. Business intelligence projects are high risk, high cost, and take too long to deliver essential insight. No wonder data is creating board-level rifts. So what next? Isn’t it time for a fresh, business driven approach?
Business leaders know that access to fast, trusted, and reliable data is increasingly key, not just to competitive differentiation but simply to keep pace with the competition. Yet more than two decades into the data revolution, organisations are now painfully aware that upwards of eighty per cent of Business Intelligence (BI) projects fail. That is, not just fail to deliver benefit, but fail to work at all!
And yet the need for better information is so strong, so compelling, that organisations continue to invest in a vain hope that, this time, it will be better. So what has gone wrong? In many ways, BI is a victim of its own self-promoted success. Reporting and analytics tools, especially the current crop of highly visual intuitive tools, are deceptively simple. They appear to turn base data, any data, into compelling and easily understood business insight at the touch of a button.
The truth is very different. BI is tough – disconcertingly so. And that is where so many companies have gone wrong. Believing the myth, hype, and sheer misinformation surrounding BI, too many companies have assumed it would be easy. They have underinvested, especially in people, and made undeliverable promises to the business users. The result? BI projects that demand ever more funding to deliver ever less corporate value.
The cost of the BI investment is also a huge point of contention because most companies simply do not understand the total cost of ownership of these types of data projects. Providing BI costs so much more than a snazzy reporting tool. By the time a company has factored in the database, data quality, ETL (Extract, Transform, and Load) software, and reporting tools, the typical cost for even a small, fifty person solution is around £200,000 per year – and that doesn’t include salaries, any required training, or hardware.
By failing to understand the complexity associated with data extraction, cleansing, and storage up front, companies find it impossible to make a valid business case. Instead, far too many businesses have invested in a pretty visualisation tool only to discover that it does perhaps ten per cent of the job, and without extensive additional investment in data quality and ETL technology, the tool is useless. At which point the realisation hits that the cost of people, time, money, and systems to address the rest of the BI project is untenable and the project is shelved. Another failed investment.
The success of any data project, especially BI, is always going to be compromised without accurate costing up front. Organisations need to be realistic. £1,000 per month on an analytics tool that delivers graphical Key Performance Indicators (KPIs) sounds great, but consider the full costs: how many people are running the project, at an employment cost of £50,000 each per year? How much has the training, the servers, the database, and the ETL tools cost? Go for full disclosure on the total BI investment and most companies will discover the true cost is closer to £25,000 per month. What ROI is that delivering to the business?
Of course BI can deliver value – massive, business changing value; but it demands a different approach. The essence of the problem is that the vast majority of BI projects are attempting to achieve the impossible by using technology that was never designed for the job. RDBMS systems that are designed for operational purposes are pretty useless for analytics. Attempts to shoehorn BI and analytics into RDBMS operational projects were, in retrospect, always designed to fail.
In an era of cloud computing and Everything as a Service, isn’t it time to consider a different model? How much more compelling for a senior manager to simply define the business need and entrust the problem to a third party that already has all the technology components and the skills required to turn the base data into business intelligence? To define a clear business analytical requirement, hand over the data and then receive, within a finite timescale, a dashboard on a mobile with eight different KPIs or real-time updates on sales in-store that reflect weather patterns or traffic flows?
By doing this organisations can remove the risks, provide cost transparency and can take the business driven approach that is at the heart of BI success. In a multi-channel world with the continuous creation of new streams and sources of data, organisations need to be able to experiment with data, change horizons and innovate at a predictable cost and with an acceptable level of risk.
With this new approach based on a business model that both de-risks and reduces BI project costs, organisations can get the right information at the right price from their data and get measurable business value for the business.