Posts Tagged ‘Data Collection’

Using Mobile Technologies in Research

Friday, July 2nd, 2010

One critical trend that is transforming the research industry is the rapid adoption of mobile technologies, especially smartphones.  It transforms research in multiple ways.  It means that people disconnect their landlines, so we have to adjust our methods for phone polling.  But more importantly, it means people are accessible in multiple ways (text, phone, email) all the time, and wherever they are.  We can ask them for feedback instantaneously in the stores where they shop, or as they are making a decision we care about.  We can talk to them, send messages, ask them to respond to survey questions, ask them to take pictures or videos for us, and so on.  There are amazing opportunities for rich, immediate data for research that we could only dream about a few years back. (more…)

Click Here for Actionable Insights!

Friday, May 28th, 2010

We saw an ad today for a downloadable survey app similar to Survey Monkey or Zoomerang that was pitched as a tool for actionable insights.  Wow!  Download, install, run . . . click again,  and there they are, sitting on your desktop or smart phone: actionable insights. (more…)

More Research on Phone vs. Online Surveys

Friday, May 7th, 2010

Another article was just published in the Spring 2010 issue of Public Opinion Quarterly exploring data quality differences between online surveys and phone surveys. The findings were based on a lab experiment in which subjects completed survey questions either on a computer or over an intercom system with an interviewer. Doing the study in a laboratory isolated the mode effect of computerized self-administered data collection vs. an interview conducted by a human. (more…)

How Long Should a Survey Be?

Friday, April 23rd, 2010

Asking people to fill out long, tiresome, and boring surveys is a scourge of the research, polling, and survey industry.  (Another is asking them to fill out a survey every time they interact with you — see There Are Too Many Surveys.)  Asking people to fill out long surveys teaches them to avoid surveys in the future, and indeed we see survey participation rates continuing to decline.  But more importantly if you are the one who needs to rely on survey data, long surveys result in measurably lower data quality. (more…)

How Good Are Online Survey Panels?

Thursday, April 1st, 2010

Ten years ago, surveys through online panels were rare.  Mostly we conducted telephone surveys.  Today it is the other way around.  With online survey panels being a $2 billion industry in the U.S., there is now a wealth of comparative data to measure and assess the implications of using online surveys as a substitute for phone surveys.

The American Association of Public Opinion Research (AAPOR) convened a task force in the fall of 2008 to study online survey panels, and they have just released their report.  It summarizes issues related to recruitment, panel maintenance, post-survey statistical adjustments, validity, and reliability.

Here is a summary of their conclusions and recommendations (quoted verbatim): (more…)

When to Kick Out a Survey Respondent

Thursday, March 4th, 2010

Nearly every survey begins with screening questions to ensure that only the people you are trying to reach are included in the survey.  For example, if you are conducting a survey of women, you need to ask about gender and kick out the men.  And because every question costs money, you want to qualify respondents quickly and terminate those who do not belong.

Here is a helpful hint: Do not actually terminate respondents until after you have asked all screening questions.  (more…)

How to Conduct a Telephone Survey for Gold Standard Research

Thursday, February 25th, 2010

Telephone surveys are still considered the gold standard for rigorous public opinion polling and market research.  The reason is that virtually every household in the U.S. can be reached by telephone, and therefore we have careful methods of determining the probability that any individual person is included in a sample to be surveyed.  Knowing this probability is at the core of statistical inference, which makes mathematical purists very happy.

Here are the steps involved in conducting a rigorous “gold standard” telephone survey of the U.S. population: (more…)

Top Trends of the Decade: Looking Ahead

Thursday, January 7th, 2010

In the previous post we noted that our industry is driven by data and information, which meant huge changes in the nature of our work over the last ten years.  Looking ahead, here are what we predict will be the five biggest trends that will shape market research challenges in the decade to come: (more…)

Top Trends of the Decade: Looking Back

Thursday, December 31st, 2009

As an industry driven by data and information, market research and public opinion polling has seen dramatic changes in the last ten years and will no doubt change quickly and in big ways during the next ten.

Looking back, here are what we consider to be the five biggest changes that shaped current challenges faced by market research and opinion polling: (more…)

People Don’t Lie on Surveys

Thursday, December 24th, 2009

For some reason I’m always a little surprised that people tell the truth on surveys.  I like to think of my “healthy skepticism” as a professional asset, because it forces us to check and double check, corroborate and triangulate.  Before we commit to the findings of a research effort, we need to feel 100% sure we’re right and that our findings are based on solid data. (more…)