Archive for the ‘Methods & Tools’ Category

Social Media and Customer Satisfaction Research

Friday, July 30th, 2010

This past Monday I moderated a panel of thought leaders in market research to ponder the question: “How Will Social Media Change Customer Satisfaction and Loyalty Research?” The event was sponsored by the American Marketing Association, and included participants from GfK, Maritz, MARC, SAS, Market Tools, and Versta Research.

One of the fascinating insights to emerge from our discussion was that social media is not only a new channel of information and data, but that it is fundamentally different from previous channels of data. As such, it opens up new areas of inquiry for our efforts. What is that fundamental difference? It is the networked nature of social media. As we code and tabulate people’s comments on social media as part of our CS&L research, potentially we have access to the networks of each person whose comments we are analyzing. We can know how many people are reading each comment, we can measure how strong and extensive the network of influence is, where it overlaps important segments of customers, and so on.

The implications of this are huge. The impact of loyalty among one’s best customers can now be defined not only in terms of how much they buy and how “sticky” they are, but also in terms of their influence among other customers and prospects. Smart CS&L research will not count everyone’s opinion the same, but will give more weight to those occupying central nodes of critical networks. There are implications for sampling as well. Is true random sampling necessary, or can “networked” sampling provided sufficient entry points that give visibility into the full population of customers?

In my view, this sort of network analysis will bring about a seismic shift in CS&L research, though not all panelists agreed. We were split about 50/50 on whether social media constitutes just one more channel of data to integrate, bringing greater precision to what we’ve always done, or whether it represents a more radical departure. A full report of our panel’s deliberations will be presented in the October 2010 issue of Marketing News, the AMA’s monthly magazine.

The stimulating discussion among panelists also highlighted the importance of remembering that good CS&L research requires ongoing thoughtfulness, intelligence, and curiosity. New tools and technologies are often easy to install, but their value is in offering new opportunities to bring deeper understanding and analysis to research.

Stay tuned – we’ll provide a closer look at some of those opportunities for better research (and reprints upon request) when the AMA publishes its report this fall.

Joe Hopper, Ph.D.

Forget about Research — Focus on Verstehen

Friday, July 23rd, 2010

Early this month, David Blackwell, a prominent statistician and mathematician died at the age of 91.  For many he is well known because he was the first African American to be elected to the National Academy of Sciences.  For others, he is well known because he wrote an important and early book about Bayesian statistics, a type of statistics that is becoming central to market research.

For those of us at Versta Research, he is well known for his focus on understanding versus research:

“Basically, I’m not interested in doing research and I never have been,” he said. “I’m interested in understanding, which is quite a different thing. And often to understand something you have to work it out yourself because no one else has done it.”  (From an interview cited in the New York Times) (more…)

Visualizing Data: Five Tips to Using a Bar Chart

Friday, July 9th, 2010

Telling a story with data is one part finding the right words, and one part finding a compelling visual way to present numbers.  Good visualization of data conveys the “big picture” at a glance.  At the same time, it includes details so that the audience understands and sees both the whole and the parts.  Effective charts also invite visual comparisons so that the viewer sees (without having to think about) the trends and patterns we are highlighting in a story.

We highly recommend learning about theories of presentation, perception, and data visualization, and we are big fans of Edward Tufte’s approach to visual explanations.  At the same time, we recommend learning the basics of using simple tools, like pie charts, bar charts, line graphs, and so on.  One good source for developing a mastery of the basics is a book called Graphing Statistics & Data: Creating Better Charts, from which we have learned a few tips about using bar charts: (more…)

Bridging the Quantitative-Qualitative Gap

Friday, June 25th, 2010

The summer 2010 newsletter from Versta Research focuses on how to bridge the gap between quantitative research and qualitative research, whether it be market research or academic research.  Both methods give rich insights, and both offer compelling ways to summarize and communicate data.  But rarely does each method draw upon the strengths of the other.

How do you bring the two together?  (more…)

Cross Cultural Survey Guidelines

Wednesday, June 16th, 2010

We are currently engaged in a research project for a client in South Korea, so issues of cross-cultural communication are top-of-mind for us right now.  Whether we rely on translations, or whether we speak the same language as our clients and respondents, it is important for researchers to understand differences in how people think and respond to research questions because data is always context sensitive. (more…)

Can Tweeting Replace Polling?

Wednesday, June 9th, 2010

The idea that online panel surveys can replace telephone surveys ruffles feathers among my colleagues at the American Association of Public Opinion Research (AAPOR). So what would they think of using Twitter posts as a substitute for phone surveys?

The idea seems crazy, but as reported in Science, researchers at Carnegie Mellon University have found that certain kinds of twitter data can give them a good read on public sentiment. (more…)

Trouble for Phone Surveys: Nobody Talks

Thursday, June 3rd, 2010

In the old days (decades ago), phone surveys had limited utility because many people had no phone service in their homes.  When that changed, phone surveys became ubiquitous because they allowed researchers better control over the process.  Data quality improved.  Now increasing numbers of people have moved to cell phones only, which has been a significant challenge for the survey industry.  The numbers are staggering:

The number of people without home access to landline telephones is increasing.

Almost half of adults under age 30 live in a household with only wireless telephone service.

(more…)

Click Here for Actionable Insights!

Friday, May 28th, 2010

We saw an ad today for a downloadable survey app similar to Survey Monkey or Zoomerang that was pitched as a tool for actionable insights.  Wow!  Download, install, run . . . click again,  and there they are, sitting on your desktop or smart phone: actionable insights. (more…)

More Research on Phone vs. Online Surveys

Friday, May 7th, 2010

Another article was just published in the Spring 2010 issue of Public Opinion Quarterly exploring data quality differences between online surveys and phone surveys. The findings were based on a lab experiment in which subjects completed survey questions either on a computer or over an intercom system with an interviewer. Doing the study in a laboratory isolated the mode effect of computerized self-administered data collection vs. an interview conducted by a human. (more…)

Don’t Do Research in Your Sleep

Sunday, May 2nd, 2010

A colleague in market research once complained to me that he felt bored and unchallenged by all the client satisfaction and loyalty research he was doing, claiming he had mastered it to the point that he could do satisfaction and loyalty research in his sleep. I was struck because I could not think of any market research that I found boring or unchallenging, and certainly none that I could do in my sleep.  On the contrary, my experience is that doing great research requires intellectual work and waking thoughtfulness no matter how many times it is done and for how many clients. (more…)