Diaper Genies for analysts (i.e. simple tools and tricks to help you work better)

With a new baby, you come to appreciate the small inventions that make a big difference. The Baby Bjorn, the Diaper Genie, the baby monitor: these are simple, well-designed technologies that can save your sanity.

Which got me to thinking: What are the Diaper Genies for data analysts? What are the little tools that solve nagging problems in a light, simple, intuitive way? I put together a starter list below of a few of my favorites. The thing that's amazing about these tools and tricks is that they have changed my usage behaviors. By simply eliminating a few clicks or keystrokes, I work differently and more efficiently.

  • MWSnap is a bit of freeware by Mirek Wojtowicz that lets you easily capture images on your screen. Pre-MWSnap, I often found myself using the Windows Ctrl-PrtSc function when making presentations. Then I would have to chop down the full screen capture in an image editing program. This application lets you grab just the part of the screen you need, then copy and paste it right into PowerPoint.
  • Keyboard shortcuts in Excel. Keyboarding both saves you time and expands your ability to work effectively with large data sets. There are two kinds of keyboarding that we teach: 1) using the Alt key with letters to navigate the menu structure (e.g. Alt-i-r to insert rows, Alt-e-s-v to paste special). 2) using the Ctrl and Shift keys with the arrows to move around and grab blocks of data. See Chris' keyboarding game. Everyone rolls their eyes when we harp on keyboarding as an essential element to being effective with Excel; I've seen too much value from the skill to care.
  • Excel Pivot Tables."What's easy about PivotTables?!," you say. Admittedly, this tool doesn't exactly fall under the category of simple and quick to learn. In fact, we are still looking for an intuitive way to teach Pivot Tables. Here are a few good tutorials I've come across. In my experience, you have to put up with a short and mildly painful learning curve; it's worth the trip. I've seen many analysts who still rely on vlookup functions when a simple Pivot Table would let them manipulate their data far more quickly. We are developing a post that offers our tips and tricks on working with Pivot Tables.
  • Voice IM (e.g. Google Talk, Skype). There is a form of conversation that requires less focused discussion than a phone call but more verbal interaction than instant messaging. This is where the voice talk features on many IM clients become valuable. Often Chris and I will open a Google Talk call while we work on something together. Long silences suddenly feel acceptable since it's free.
  • Windows Alt-Tab. This key combination gives you the ability to flip between applications and can be a huge time saver. I've found it especially useful when I'm pulling data from application and dropping it into another.
  • Faster web browsing with Firefox. Mozilla's Firefox browser touts its security, pop-up blocking, and extensions as differentiators. The features I care about are those that help me manage the information better. Ctrl-f gives a 'find' box in the bottom of your browser where you can start typing instantly. It jumps you right to the part of the page with your word/phrase. Tabbed browsing and the ability to jump between tabs (Ctrl-PgUp or -PgDn), close tabs (Ctrl-w), or open a new tabs (Ctrl-t) lets me work with half a dozen web sites at the same time.
  • Google Desktop. The new version has a feature where you can press Ctrl twice and it pops a search box. Not only is this a better tool for finding files than Windows offers, but it can quickly find applications. You may never have to go to that Windows Start button again!

We don't claim to be productivity gurus like Merlin Mann of 43 folders or the folks at Lifehack, but I think you'll appreciate how these tools seem to scratch an itch then mercifully leave you alone. They give you a sense of control that is about the opposite of MS Word deciding how your bullets should look.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

3 comments


June 6, 2006
Fred said:

I fully agree with your comment on Excel keyboard shortcuts... I feel like I'm missing an arm and a half if I can't use these shortcuts.

So here's my question: I'm switching to Mac, and Excel 2004 doesn't appear to have support for this type of navigation. Is there any way around this, or to get it to work with the shortcuts as in Windows?

Thanks


June 6, 2006
Zach said:

You question could hardly be more timely for us. We are also looking at switching to the new MacBooks. As you know, we are obsessive about Excel keyboarding (it can feel like a superpower) and the fear is that we will be reduced to the typing equivalent of hunt-and-peck people.

Here's a good article I found about keyboarding on Macs:
http://www.macworld.com/2004/09/secrets/septworkingmac/index.php/


September 14, 2006
hjmm said:

perfect information!enjoyed!Thank You!
<a href="lalal.ru" rel="nofollow">click</a>

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





Correcting a small oversight

A reader wrote to point out a small oversight in last week's introduction of the Excel Chart Cleaner tool.

Installed your chart fixer upper tool...and it seems to have been installed because it shows up checked in my add-ins list. But how do I actually USE it? If I have a sheet of data and make a line chart out of it...where is the button to press to clean it up with your add-in? Maybe I'm too much of a neophyte to be reading your blog and trying this stuff...but maybe you could let people know how to actually use this excellent tool you've provided instead of just installing it.

Thanks so much for putting this stuff out there. I learned more about Excel reading your blog than in several paid training sessions. Worth the price of getting out of bed today!

So, you're one of those sneaky people that actually wants to USE the tool. Hmmm.

Well, here's the secret: the add-in puts a menu item in the Format menu. If you have a chart already selected it will say "Clean this chart..." otherwise, it says, "Clean all charts...". Select the option and you'll get a number of ways to clean and simplify the chart.

Thanks for the kind words. There's a screencast coming on how and why to use the Chart Cleaner tool.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

3 comments


May 12, 2006
Josh said:

Thanks for posting my question. I continue to LOVE chart cleaner. So simple yet so powerful. My charts are so much more elegant now. Thanks again for this little gadget. -jk


May 27, 2006
Joe said:

I like your chart cleaner concept, but I don't care for the "mil" for million. I've never seen mil used in business charts.


May 27, 2006
Chris said:

Thanks Joe. I'm not _crazy_ about "mil" either, but I do think most people would understand what it means in context.

The terminology I've seen most for annotating business charts is "M" for thousand and "MM" for million. Personally, I don't think this is very clear either. Why "M"?

Do you have a suggestion?

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





Best of Juice blog

Welcome to the Juice Analytics blog. We've gotten quite a few new visitors from Chris' podcast discussion with Jon Udell. If you are new, thanks for stopping by. Our blog covers a range of topics, from data visualization to Excel and PowerPoint tips and tricks to our business analytics approach. Here's a brief "best of" list to help you get acquainted:

Thanks for visiting; we love to hear from our readers so send us an e-mail or leave a comment.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

1 comment


August 30, 2006
russell said:

learn a lot from your blog...

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





A data warehouse problem...And, cuddling up with Bill Gates

Andy Hayler from Kalido is a great read for a no-nonsense perspective on business intelligence. He wrote recently.

"Meanwhile, a survey of 1,000 UK business managers at companies with over 250 staff, published by ICS, indicates a widespread need for better BI systems. The study found that over three quarters of respondents were forced to make decisions 'blind' due to late or insufficient business information". By contrast, this is entirely believable, though not for the reason that the article gave. The critical issue is that you can have as many pretty reporting tools and dashboards as you like, but you need accurate and timely information to feed those systems coming from a data warehouse (unless you are one of the few brave souls using EII). The problem is that most data warehouses are entirely unable to keep up with the pace of business change (reorganisations, acquisitions etc) and so are constantly out of date. Consider a data warehouse with just ten source systems. A major change in one of its sources will impact the warehouse schema, and may take three months to fix the schema, the load routines and the reports that are impacted by the change (this is a pretty typical figure in my experience at Shell).

A major change of this type does not happen every day, but is almost certain to happen once a year to each of these source systems, maybe twice. There are then ten sets of separate changes, each taking three months worth of changes needed to the warehouse every year. Even assuming that the changes are neatly spread over the year and that you have plenty of programming resources to fix the changes, so you can do these in parallel, you still have 15 months of change to fit into 12 months; basically the warehouse can never catch up. You may well have more than 10 sources for your data warehouse, so the problem could be even worse than this. This is indeed what happens in reality: the data warehouse is usually out of date, so armies of Excel jockeys in finance get the answers via email and have to manually number-crunch for anything really critical while the warehouse lumbers on with out of date information. This situation is not the fault of the BI tools—it is the fault of the data warehouses that feed the BI tools. Until companies admit that the status quo is failing and start abandoning custom-build warehouses this problem will persist. It is like with treating alcoholism: the first step is admitting that there is a problem.

We've long been skeptical of top-down analytics that try to centralize a businesses information and knowledge. Andy's post highlights one problem with this approach - change happens. Here's another problem - you don't know what you don't know when you build a warehouse.

In other news, I've cut my six degrees of separation to Bill Gates down to two. More later.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

0 comments | Add a comment

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment






Fixing Excel charts...Or, why cast stones when you can pick up a hammer

It's always better to suggest a solution than criticise. Recently, we've slung stones at Excel's default charts. The default colors are bad, and some of the built-in charts are "what were the smoking?" ugly.

Edward Tufte and others provide principles for making good infographics, but beating Excel's rusty butterknife into an explanatory sword is hard. People who want to make nice looking charts waste time fixing them up. People who don't care about making nice looking charts inflict those charts on others.

We have a solution. The "Clean Charts" tool turns hard-to-read Excel default charts into Tufte-compliant wonderwerks in a single click. Here's what it does:

  • Removes "chart-junk" (the contrast-reducing light grey background on most Excel charts, extraneous lines)
  • Formats the axes with easy to read numeric formats (22000 becomes "22k")
  • Changes series colors to an optimally chosen set that are designed for maximum contrast and readability
  • Removes 3D from the chart. 3D charts introduce distortions that make it hard for people to understand your numbers.
  • Fixes axis scaling problems.
  • Fixes font and marker sizes to make them readable if you have resized your chart

To try Clean Charts and install it, download both these files into the same directory. Then open the Clean Charts Installer.xls file with macros turned on. Follow the instructions inside the installer.

CleanCharts.zip

To turn macros on, go to Tools, Macro, Security. Select Medium security level. Close the workbook and re-open it. On re-opening, when Excel gives the security warning that asks if you want to enable macros, choose "Enable Macros".

The add-in puts a menu item in the Format menu. If you have a chart already selected it will say “Clean this chart…” otherwise, it says, “Clean all charts…”. Select the option and you’ll get a number of ways to clean and simplify the chart.

This project is offered under the MIT License.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

23 comments | Show all comments only the last 5 are shown


December 31, 2007
Simon said:

This was an excellent find on Google. Thanks a lot. One issue is that it maxes out at 6 series. I have a stacked area chart with 7 series and it made the seventh white. I only just spotted it as I proof read my report!


May 20, 2008
Andreas said:

Chris -- Just wondered if the problem I had in my December 7 post got addressed. Please advise.

Rgds,
A


May 28, 2008
Ole said:

Thanks for the cleaner. However, I couldn't make it work in Excel 2003. It did say install, and the macros are on and the menu item is there - but nothing happens when I select a chart and press. Any ideas?


May 29, 2008
James said:

Ole, I also had that issue in Excel 2003, but only on charts that aren't located in a sheet. Change the location of the chart to inside another sheet and see if that fixes it for you


June 19, 2008
Vadim said:

Installs and works great on Excel 2k, except that it mangles charts with multiple scale bars (e.g. Amount on Left Y-scale and Date on right Y-scale). But turns out if you turn of the "fix 3d" options, then it leaves the graph in tact.

Also, for a scatter chart type (useful when dealing with dates) it removes the connecting lines, but leaves them for a line chart type. Can this be fixed? Thanks.

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





A new member of the family

I attribute my intolerance for graphics ugliness (see our post on Excel colors) to being the son of an artist/photographer. Growing up, this meant kitchen sinks full of oil paint brushes and new works slowly taking shape in the studio.

His works are figurative and whimsical at times. Or in his words: "The iconography I use centers around people because that's my greatest interest: how people think and feel as individuals, how we interact with each other intimately and as a society." An original mash-up artist.

My dad has just launched Potato Hill Artworks, an online store to sell fine-art limited edition prints of his oil paintings. Check it out if you're looking for something unique. A few of my favorites:

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

0 comments | Add a comment

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment






Excel Geocoding Tool v2

I'm happy to announce a few small revisions to our Excel geocoding tool. The tool takes a list of addresses and will look up the latitude and longitude of those addresses. The addresses can then be exported as a Google Earth map.

A user pointed out that the tool wasn't looking up zip+4 codes properly in Yahoo and this problem is fixed along. Also, I'm sorry to report that Yahoo has lowered their limit of free geocodes to 5,000 per day from 50,000 per day.

Geocoding Tool v3.1.xls

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

30 comments | Show all comments only the last 5 are shown