Archive for the ‘Market Research’ Category

Social Media and Customer Satisfaction Research

Friday, July 30th, 2010

This past Monday I moderated a panel of thought leaders in market research to ponder the question: “How Will Social Media Change Customer Satisfaction and Loyalty Research?” The event was sponsored by the American Marketing Association, and included participants from GfK, Maritz, MARC, SAS, Market Tools, and Versta Research.

One of the fascinating insights to emerge from our discussion was that social media is not only a new channel of information and data, but that it is fundamentally different from previous channels of data. As such, it opens up new areas of inquiry for our efforts. What is that fundamental difference? It is the networked nature of social media. As we code and tabulate people’s comments on social media as part of our CS&L research, potentially we have access to the networks of each person whose comments we are analyzing. We can know how many people are reading each comment, we can measure how strong and extensive the network of influence is, where it overlaps important segments of customers, and so on.

The implications of this are huge. The impact of loyalty among one’s best customers can now be defined not only in terms of how much they buy and how “sticky” they are, but also in terms of their influence among other customers and prospects. Smart CS&L research will not count everyone’s opinion the same, but will give more weight to those occupying central nodes of critical networks. There are implications for sampling as well. Is true random sampling necessary, or can “networked” sampling provided sufficient entry points that give visibility into the full population of customers?

In my view, this sort of network analysis will bring about a seismic shift in CS&L research, though not all panelists agreed. We were split about 50/50 on whether social media constitutes just one more channel of data to integrate, bringing greater precision to what we’ve always done, or whether it represents a more radical departure. A full report of our panel’s deliberations will be presented in the October 2010 issue of Marketing News, the AMA’s monthly magazine.

The stimulating discussion among panelists also highlighted the importance of remembering that good CS&L research requires ongoing thoughtfulness, intelligence, and curiosity. New tools and technologies are often easy to install, but their value is in offering new opportunities to bring deeper understanding and analysis to research.

Stay tuned – we’ll provide a closer look at some of those opportunities for better research (and reprints upon request) when the AMA publishes its report this fall.

Joe Hopper, Ph.D.

Forget about Research — Focus on Verstehen

Friday, July 23rd, 2010

Early this month, David Blackwell, a prominent statistician and mathematician died at the age of 91.  For many he is well known because he was the first African American to be elected to the National Academy of Sciences.  For others, he is well known because he wrote an important and early book about Bayesian statistics, a type of statistics that is becoming central to market research.

For those of us at Versta Research, he is well known for his focus on understanding versus research:

“Basically, I’m not interested in doing research and I never have been,” he said. “I’m interested in understanding, which is quite a different thing. And often to understand something you have to work it out yourself because no one else has done it.”  (From an interview cited in the New York Times) (more…)

Bridging the Quantitative-Qualitative Gap

Friday, June 25th, 2010

The summer 2010 newsletter from Versta Research focuses on how to bridge the gap between quantitative research and qualitative research, whether it be market research or academic research.  Both methods give rich insights, and both offer compelling ways to summarize and communicate data.  But rarely does each method draw upon the strengths of the other.

How do you bring the two together?  (more…)

Can Tweeting Replace Polling?

Wednesday, June 9th, 2010

The idea that online panel surveys can replace telephone surveys ruffles feathers among my colleagues at the American Association of Public Opinion Research (AAPOR). So what would they think of using Twitter posts as a substitute for phone surveys?

The idea seems crazy, but as reported in Science, researchers at Carnegie Mellon University have found that certain kinds of twitter data can give them a good read on public sentiment. (more…)

Of Lust and Tracking Studies

Wednesday, May 19th, 2010

Today, an industry colleague (another owner of a market research firm) said to me, “We all lust after those big tracking studies.”  For most market research firms, tracking studies are attractive because they involve big samples, multiple ongoing deliverables, and multi-year commitments, all of which means predictable, ongoing (and usually substantial) revenue.

At Versta Research, we lust after them for a different reason: they are the true test of whether our key personnel can really add value and insight to the work that we do.  How do you take something routine and predictable, and turn it into an effort that delivers an “Aha” every week?  Here’s how we do it: (more…)

Don’t Do Research in Your Sleep

Sunday, May 2nd, 2010

A colleague in market research once complained to me that he felt bored and unchallenged by all the client satisfaction and loyalty research he was doing, claiming he had mastered it to the point that he could do satisfaction and loyalty research in his sleep. I was struck because I could not think of any market research that I found boring or unchallenging, and certainly none that I could do in my sleep.  On the contrary, my experience is that doing great research requires intellectual work and waking thoughtfulness no matter how many times it is done and for how many clients. (more…)

Five Research Design Tips

Friday, April 16th, 2010

Good research happens by design.  That is one of the reasons we enjoy writing research proposals.  Writing proposals is an exercise in research design, which is the place and time where you must think in strategic and smart ways about what you are going to do and how you are going to do it.  You must do it, that is, if you want your research to be any good.

How do we begin the research design process to ensure incisive and smart research that really helps our clients answer their critical questions?  Here are five key elements of the process for us, which we offer to you as tips for your own success when launching an internal research effort: (more…)

Practical Statistics vs. Theoretical Statistics

Friday, April 9th, 2010

If something works and it keeps on working but you don’t know exactly why it works, what would you do?  Our view is that you should keep doing it.  Not everyone agrees with us.  The American Association of Public Opinion Research (AAPOR) convened a task force to study online survey panels, and released their report last month (we posted a summary of findings last week).  To us, the most jarring statement in the report was this:

“There currently is no generally accepted theoretical basis from which to claim that survey results using samples from nonprobability online panels are projectable to the general population.”

Even with careful statistical weighting based on demographics, known biases, propensity to be online and partake in surveys, and so on, the report concludes that online panels should not be used to estimate population parameters.  Why?  Not because this method doesn’t work (in many cases it does) but because there is no statistical theory to explain why it works, in contrast to probability sampling, for which there is solid theory explaining why it works. (more…)

The Art of Asking Questions

Friday, March 19th, 2010

This quarter’s newsletter from Versta Research focuses on the art of asking questions.  We suggest that the importance of business questions far exceeds the importance of survey questions or focus group questions.  You can’t do the latter without the former, at least not very well, and research that is not specifically designed to answer clearly articulated business questions usually falls flat.

Here are some great quotes we found to keep in mind as guiding principles: (more…)

When to Kick Out a Survey Respondent

Thursday, March 4th, 2010

Nearly every survey begins with screening questions to ensure that only the people you are trying to reach are included in the survey.  For example, if you are conducting a survey of women, you need to ask about gender and kick out the men.  And because every question costs money, you want to qualify respondents quickly and terminate those who do not belong.

Here is a helpful hint: Do not actually terminate respondents until after you have asked all screening questions.  (more…)