The Last Mile of Business Intelligence

“The last mile” is a term that often is applied in the telecom industry in reference to “the final leg of delivering connectivity from a communications provider to a customer.” It is an expensive and complex step due to the challenge of pushing information from centralized, high capacity channels to many, diverse end-points where information is ultimately used.

We think there is a “last mile” problem in business intelligence too. This critical bridge between data warehouses and communication of insights to decision-makers is often weak or missing. Your investments and meticulous efforts to create a central infrastructure can become worthless without effective delivery to end-users. “But how about my reporting interface?” you wonder. That’s a creaky and narrow bridge to rely on for the last mile of business intelligence.

Bridge

Listening to our clients, we are confident the last mile is a real problem. The ultimate source of this failure is less clear. Here are a few of theories:

1. The engineers who built the data warehouse build the interface. No offense to the talented individuals who can push around, clean, normalize, and integrate data — but they may not be ideally suited to designing a user interface for non-technical users. A designer wouldn’t create charts that look like this (our favorite example of chart-based encryption)

Chart-based encryption

In the worst case, developers are dismissive of user experience. I’ve met with IT folks who felt confident that providing a massive data table would provide a suitable solution for delivering information to users. “Hey, they’re getting their data. Is there a problem?”

2. Reporting is considered the fundamental mechanism for working with data. Here’s a framework we’ve started to consider in thinking through the multiple approaches for getting value from data:

Last mile triangle

  • Reporting lets you monitor things that are well-understood and relatively predictable.
  • Exporation or analysis helps you understand new processes, erratic and shifting behaviors.
  • Presentation is about communicating insights and understanding, often building on both reporting and analysis.

Many people assume that a reporting tool is sufficient to do in-depth analysis and communicate results. That’s like trying to build a deck with a screwdriver.

3. Poor fundamentals in information display. Despite the efforts of folks like Edward Tufteand Stephen Few, general literacy in this area is still low. Shiny, 3D pie charts are still acceptable, even desirable in some places. Particularly disturbing is the persistence and pervasiveness of this problem in Excel where there still remains some confusion as to why this is bad information display:

Excel data bars

You don’t have to go any further than the Dashboard Spy to find examples of the visual muck that is commonplace.

15 comments | Show all comments only the last 5 are shown


November 6, 2007
Jennifer E said:

We are in the "Last Mile" in my project where I am embarrassed to say that I manage the User Interface. I struggle with everything you have mentioned above. Unfortunately, the company I work for does not feel it important to invest in UI and my team is sparse and has been over run with the Data Modelers with no design sense. If just 2% of our time was spent on usability we would have much easier to understand product and the training to use it would be greatly reduced.. I will keep reading your blogs.


November 6, 2007
Zach said:

Jennifer: I'm sorry to hear about our situation. It raises the question: Does a lone, screaming user interface person in the Data Modeler woods make a sound? We'd be happy to lend a sympathetic ear if you want to reach out.

Sanjay: Our experience has been very different from what you describe. We've found it rare that management and tech work so smoothly "in concert." I have yet to see a BI implementation that consistently brings joy and insight to end-users. Furthermore, it seems a stretch to attribute 15+ years of global business growth to the success of these EIS/BI systems. On the other hand, it seems like you have a Harvard Business Review article in you.


November 11, 2007
Sanjay Tamta said:

Zach:

That was funny and your point is well taken. Actually, I think an HBR article may just hit the spot.

Good blog btw.

Sanjay


November 21, 2007
James Taylor said:

Nice post and inspired me to post on something similar over at http://www.edmblog.com/weblog/2007/11/mistakes-in-the.html
JT


May 1, 2008
Mark said:

Good post and you can see similar examples at <a hfre="http://www.dashboardzone.com">Dashboard Zone</a>

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment