Posts Tagged ‘Internet’

Just Published: Handbook of Web Surveys

Wednesday, January 18th, 2012

Many of us in marketing research have been deploying web surveys for over ten years, and web surveys are, by far, the dominant mode of data collection in our industry nowadays.  But our techniques and methods are an amalgam of practices adapted from other data collection modes, learned in part through trial and error, and taught to others through channels more akin to oral traditions.  So it is helpful when our academic colleagues manage to document and codify the art and science of what we do. (more…)

Tips for Sampling from Online Panels

Wednesday, November 23rd, 2011

Versta Research is a strong advocate for using online panels for surveys.  As telephone usage and technology have changed, phone surveys are increasingly difficult and expensive, and they are not necessarily more rigorous than other methods.

But that doesn’t mean “anything goes” when it comes to fielding market research surveys and public opinion polls through online panels.  Many panels are poorly managed and overused, and some have high proportions of fraudulent respondents.  While conducting good research through online panels is possible, it requires a great deal of effort and oversight from smart people who know what they are doing.

I was reminded of this recently as we worked with a newer panel provider that recruits respondents through not-for-profit organizations. (more…)

Internet Surveys and the Associated Press (AP)

Thursday, September 29th, 2011

Is it true that the Associated Press refuses to carry stories from online surveys?  Yes, as odd as that seems nowadays.  But news media face a difficult problem given how easy it is to conduct biased public opinion polling, especially now with online panels and social networks.  So some news organizations like the Associated Press (AP), The New York Times, and ABC News have developed guidelines that specify for a survey or public opinion poll to be valid and reliable, it must be conducted by telephone.

(more…)

Using Avatars & Robots for Survey Research

Thursday, September 22nd, 2011

Two researchers at the U.S. Census Bureau recently outlined an emerging innovation in survey research that could reverse the trend towards passive, boring, self-administered surveys that characterizes much online research.  The idea is to use internet avatars in real-time interviewing with survey respondents.

Beyond just the heightened interest of having an animated survey, the avatars would be programmed to register and interpret respondents’ verbal answers, facial expressions, and body language through webcams.

(more…)

Smartphones Matter More than Cell Phones

Friday, August 19th, 2011

The most recent government estimates of cell phone usage among U.S. households were released a few weeks back, and the pace at which landline usage is disappearing is astonishing.  Here are just some of the numbers:

  • Thirty percent of U.S. households do not have a landline telephone
  • An additional 16% have a landline telephone, but never or rarely use it to receive calls
  • The percentage of households without landlines is increasing by about five to six percentage points each year
  • Half of young adults under age 30 have no landline in their homes
  • Half of adult renters have no landline in their homes
  • Nearly four out of ten Hispanic adults have no landline in their homes

(more…)

How to Boost Response Rates for Online Surveys

Wednesday, June 29th, 2011

One of the surprises of multi-mode research is that offering people a choice of how they want to complete a survey (online, by mail, by phone, etc.) does not necessarily boost response rates.  An article in the most recent issue of Public Opinion Quarterly provides new evidence of this.  The study showed that even in a population with full access to both mail and Internet options (and full literacy in both modes), a full mail survey achieves a higher response rate than a web-based survey.  It also achieves a higher response rate than a choice of either mail or web.  So much for our recent article on The Myth of Too Many Choices!

But the study went further to explore some ways of sequentially deploying multiple survey options and multiple modes of information that can substantially boost web-based survey response rates.  Here are some key takeaways from the research: (more…)

Online Surveys Have Same Accuracy as Phone

Thursday, May 26th, 2011

A new study presented by two professors from Harvard University and the University of Massachusetts at Amherst was probably one of the liveliest and potentially disruptive presentations at least week’s annual meeting of the American Association of Public Opinion Research (AAPOR) in Phoenix.

Why?  Because their research challenges the beliefs of many AAPOR-ites who disregard most online research as being theoretically indefensible since it is not based on probability sampling.  The research presented was based on parallel surveys conducted last year, designed to allow careful comparison of three survey modes:  (more…)

Tips for Surveys on Smartphones

Thursday, January 27th, 2011

The technology to field surveys via mobile devices has been around for a while, but has not yet gained much traction (and for good reasons).  But with smartphones now proliferating at a remarkable pace, we may be in for a change.  Deloitte released their 2011 IT and technology predictions last week, arguing that smartphones are likely to account for almost half of computer spending during the year. (more…)

How Good Are Online Survey Panels?

Thursday, April 1st, 2010

Ten years ago, surveys through online panels were rare.  Mostly we conducted telephone surveys.  Today it is the other way around.  With online survey panels being a $2 billion industry in the U.S., there is now a wealth of comparative data to measure and assess the implications of using online surveys as a substitute for phone surveys.

The American Association of Public Opinion Research (AAPOR) convened a task force in the fall of 2008 to study online survey panels, and they have just released their report.  It summarizes issues related to recruitment, panel maintenance, post-survey statistical adjustments, validity, and reliability.

Here is a summary of their conclusions and recommendations (quoted verbatim): (more…)

How to Conduct a Telephone Survey for Gold Standard Research

Thursday, February 25th, 2010

Telephone surveys are still considered the gold standard for rigorous public opinion polling and market research.  The reason is that virtually every household in the U.S. can be reached by telephone, and therefore we have careful methods of determining the probability that any individual person is included in a sample to be surveyed.  Knowing this probability is at the core of statistical inference, which makes mathematical purists very happy.

Here are the steps involved in conducting a rigorous “gold standard” telephone survey of the U.S. population: (more…)