Archive for the ‘Market Research’ Category

Using Avatars & Robots for Survey Research

Thursday, September 22nd, 2011

Two researchers at the U.S. Census Bureau recently outlined an emerging innovation in survey research that could reverse the trend towards passive, boring, self-administered surveys that characterizes much online research.  The idea is to use internet avatars in real-time interviewing with survey respondents.

Beyond just the heightened interest of having an animated survey, the avatars would be programmed to register and interpret respondents’ verbal answers, facial expressions, and body language through webcams.

(more…)

A Better Way to Scale MaxDiff Utilities

Thursday, September 15th, 2011

MaxDiff is a survey method used to measure the importance of product features.  Subsets of features are presented, and respondents are asked to select which feature is most important and which feature is least important.  Its advantage over other techniques is that by forcing a choice from among multiple features, it more strongly differentiates the features if customers are prone to say that all features are important or attractive.

(more…)

Three Mistakes to Avoid on Data Charts

Wednesday, September 7th, 2011

It's pretty, but it's chartjunk

Turning data into stories involves not just words, but pictures as well.  In the world of quantitative market research, that usually means charts, graphs, and tables.  Moreover, just like poorly written sentences that often complicate rather than clarify data, charts and graphs in market research too often suffer from “chartjunk,” as Edward Tufte calls it.  Any superfluous details, design elements, or decorations that do not tell the viewer something new about the data are chartjunk.

At Versta Research we write a lot of reports.  We also revise others’ reports to help our clients find and more clearly present research stories to their management teams.  Here are three of the more common chart design mistakes we see and help our clients avoid: (more…)

Pigeons Beat People on Probability Problems

Wednesday, August 31st, 2011

Monty Hall in Let's Make A Deal

The hardest part of quantitative market research is not that it involves numbers, math, or even statistics, but that it involves complex problems in probability.

Over the past several years, psychologists have been documenting how difficult it is for us humans to solve even “simple” probability problems.  One fascinating example is a puzzle known as the Monty Hall dilemma based on the 1960’s game show Let’s Make A Deal.  Monty would offer his contestants three doors to choose from, one of which had a valuable prize behind it.  After the contestant chose, Monty would open one of the other two doors, deliberately choosing one that had no prize behind it.  Then he offered the contestant an option of staying with the original choice, or switching to the other unopened door.  Which should the contestant do? (more…)

Smartphones Matter More than Cell Phones

Friday, August 19th, 2011

The most recent government estimates of cell phone usage among U.S. households were released a few weeks back, and the pace at which landline usage is disappearing is astonishing.  Here are just some of the numbers:

  • Thirty percent of U.S. households do not have a landline telephone
  • An additional 16% have a landline telephone, but never or rarely use it to receive calls
  • The percentage of households without landlines is increasing by about five to six percentage points each year
  • Half of young adults under age 30 have no landline in their homes
  • Half of adult renters have no landline in their homes
  • Nearly four out of ten Hispanic adults have no landline in their homes

(more…)

Cell Phones May Double Your Survey Costs

Tuesday, August 9th, 2011

These days most researchers agree that if you want to do a random sample phone survey of the U.S. population, you ought to include cell phones.  More than one-quarter of the population do not have landline telephones at home.  Those who do have landline telephones are less likely than ever to answer them, and less likely than ever to participate in surveys.

But it is not easy to include cell phones.  The sampling protocols and the post-stratification weighting become more complicated.  You need to account for a higher probability of cell phone owners being in your sample, because most of them also have landlines.  You can’t use automated or predictive dialing to call cell phone numbers.  You can’t target geography as well, because area codes and exchanges have become mobile.  And people get mad at you if they have to pay for incoming calls, so you need to offer cash.

What’s the bottom line effect on costs for a survey that includes cell phones?  A recent study sponsored by the American Association for Public Opinion Research (AAPOR) documents the following: (more…)

The Pitfalls of Auto-Coding Text Responses

Thursday, July 28th, 2011

An issue we continually struggle with at Versta Research is how to automate the research process and leverage new technologies without losing the essence of what good research does.  Good research does not report data, build charts, or generate dashboards. It learns, answers new questions, interprets data, and helps users focus on information and findings that are relevant to their needs.

The last couple of weeks we have been working with a group that specializes in coding and tabulating text responses to open-ended questions on surveys.  They have tools and technology that undoubtedly make the process easier and more efficient (we have used those tools, and they are impressive).  They are also have a singular focus and expertise that is supposed to help streamline the process, cut costs, and improve speed and efficiency.

The results have been mediocre at best, even with human coders working the technology and making the critical decisions. (more…)

Research Trends in Cross-Cultural Marketing

Thursday, July 21st, 2011

This year Ogilvy & Mather is launching a unit within its agency that focuses on cross-cultural marketing as opposed to multicultural marketing.  This is an important shift in how to think about multiple markets and segmentation, and consistent with what we at Versta have been seeing in our research for quite some time. (more…)

The Most Persuasive Way to Present Data

Thursday, July 14th, 2011

How statistics are calculated and presented has a huge effect on how audiences interpret information and make decisions.  A recent study about medical decisions based on drug efficacy data highlights the critical importance of how you turn your data into stories, no matter what industry.  The research shows that different stories, all of them true and all of them based on the same data will lead to sharply different assessments and decisions.  An article in the New York Times summarized one scenario tested by the researchers:

If your doctor tells you that highly reliable studies have shown that taking a certain pill will cut your risk of getting a serious disease in half, would you take it?

Suppose he adds that the risk is 2 percent for people who do not take the pill, but your risk will be reduced to 1 percent if you do. Would you still take it? And what would you do if he told you that only one of every 100 patients who take the drug will actually benefit from it?

The doctor could have said any of these things, all truthfully, because they are just different ways of describing the same data. (more…)

Top 5 Picks: Best Articles on Market Research

Thursday, July 7th, 2011

Versta Research just hit a magic number: 100.  That’s the number of articles we have written to help our clients and their colleagues keep abreast of important trends in market research.  If your market research supplier is not providing ongoing thought leadership in design, methods, and analytics, then what are the chances they are bringing ongoing and deep insight to your specific research needs?

To celebrate, we’re serving up a sampler of our five best articles.  How did we decide they are the best?  Our clients told us.  These are the articles that they write to us about, forward to their colleagues, and for which they return to our website time and again.  These are also the articles for which we get requests for print-ready PDF versions.  (Just let us know if you want one!) (more…)