Most research professionals know there is a kernel of sad truth in this Dilbert cartoon. But it is not because the world is random, so that made up numbers work just as well as accurate numbers. It is because research is often not used at all, in which case the difference between real numbers and made-up numbers just doesn’t matter.
Why is research not used? The most common reasons we see are: (more…)
We came across this chart from Invisible Children, the group that produced the Kony 2012 video. It shows the organization’s expenditures by category. It is a poorly designed chart for three reasons:
1. The pieces of the doughnut are not correctly proportional. For some reason, the arc widths were compressed for some categories (like Media & Film Creation) distorting the true size of the relationships among categories.
2. Information is squeezed onto the chart in such a way that some of it is unreadable. Even if you click on the chart to get a full-sized image, it is difficult to discern the numbers for the Media & Film Creation category.
3. Percentages are shown to two decimal places, which is unimportant. Why add extra numbers if they don’t convey extra information?
A better way to create the chart is shown below. It is less snazzy. But it shows the important data (the relative sizes of each expense category) accurately.
Even so, this chart is probably not the best choice, either. Pie charts are excellent for showing relative proportions of the whole, but once you have more than four our five slices, it is usually too much information for this type of chart, and your brain does not really process those relative proportions. (more…)
Coincidentally in the same week that Versta Research published its winter newsletter on Turning Data into Stories: A How-To Guide, last week’s AMA event in Chicago was a market research panel focused on telling stories with data. The presentations were solid, with lots of helpful ideas. But there was also a misguided idea working its way through the room, worthy of spirited debate, if only we had more time. It is the idea, as one panelist put it, that “clients don’t care about numbers.” (more…)
One powerful way to gain visibility and credibility in your marketplace is by sponsoring survey research that documents problems and solutions in areas where you have expertise. To be successful, it requires (1) rigorous research carefully designed to uncover the right topics, and (2) savvy PR work that uses data to tell a credible and compelling story.
The Public Relations Society of America (PRSA) and the American Statistical Association have just published a handy guide for PR professionals that outlines best practices for using, interpreting and reporting statistics in press releases and other PR materials. Some of those best practices include the following: (more…)
Earlier this month Arthur C. Nielsen, Jr. died. He left behind a giant and reputable market research company and a brand name recognized throughout the world. The A.C. Nielsen company was started by his father and in its early years tracked the sales of goods through grocery and drug stores. The company then moved into media tracking and became the authoritative source for measuring audience size and demographics. Nearly every company with an advertising budget continues to rely on Nielsen data to determine where to advertise and how much to spend.
Nielsen’s legacy is that he demonstrated the value of collecting and tracking data, and lots of it. Every item we purchase is now logged, counted, and tracked. Every television and radio show is tracked for how many viewers it has and in what markets they live. And of course everything we do on the Internet is recorded and tracked. Even our bodily locations are tracked via GPS or cell phone signals. Most market research firms today generate the bulk of their revenue simply by collecting, tracking, tabulating, and reporting data.
This important legacy has left us with tons of data, growing at an exponential rate, and a monumental challenge of how to synthesize it and move beyond mere tabulation and reporting. The question is, how do we meet that challenge and take Nielsen’s legacy to the next frontier? In our view, it will involve two key efforts:
Many of us have uneasy feelings when reading statistics that presumably apply to ourselves and our own lives. Often the statistics do not seem to “fit” and seem to misrepresent the lives of real people from which the statistics are derived. It is with good reason that we chuckle when someone tells us that the average U.S. household has 0.64 children in it.
We were reminded of this upon hearing prominent news reports a few days ago that the average household income in the U.S. has fallen by about 10% in the past decade, most of it happening since the start of the recession four years ago. But does that mean most Americans’ incomes are falling? No. Though it is hard not to think so given how the data are being presented and reported.
Versta Research just hit a magic number: 100. That’s the number of articles we have written to help our clients and their colleagues keep abreast of important trends in market research. If your market research supplier is not providing ongoing thought leadership in design, methods, and analytics, then what are the chances they are bringing ongoing and deep insight to your specific research needs?
To celebrate, we’re serving up a sampler of our five best articles. How did we decide they are the best? Our clients told us. These are the articles that they write to us about, forward to their colleagues, and for which they return to our website time and again. These are also the articles for which we get requests for print-ready PDF versions. (Just let us know if you want one!) (more…)
As much as we love numbers, we find ourselves often advising clients against using numeric scales in their surveys. A numeric scale is any response format that asks people to give a number within a certain range to indicate the strength of their feeling or opinion. The insanely popular survey question used to calculate Net Promoter Scores is a good example:
“How likely is it that you would recommend Acme Solutions to a friend or colleague? Please answer on a scale from zero to ten, where zero means not at all likely, five is a neutral score, and ten means extremely likely.”
There are many good reasons to use numeric scales and many types of research for which numeric scales are optimal. The NPS scale is good because it has eleven points with meaningful endpoints and a meaningful midpoint. Research shows that scales like this can be highly reliable and valid, with sufficient variability to allow for sophisticated statistical modeling.
But if your objective is to use survey data for marketing materials, public relations, news releases, or white papers, numeric scales make things difficult. They are not easy to summarize in words, and if you want to use charts that tell quick, compelling stories, you will end up having to do something like this:
A Poor Fit: Pie Charts and Numeric Scales