We are currently engaged in a research project for a client in South Korea, so issues of cross-cultural communication are top-of-mind for us right now. Whether we rely on translations, or whether we speak the same language as our clients and respondents, it is important for researchers to understand differences in how people think and respond to research questions because data is always context sensitive. (more…)
Posts Tagged ‘bias’
Cross Cultural Survey Guidelines
Wednesday, June 16th, 2010More Research on Phone vs. Online Surveys
Friday, May 7th, 2010Another article was just published in the Spring 2010 issue of Public Opinion Quarterly exploring data quality differences between online surveys and phone surveys. The findings were based on a lab experiment in which subjects completed survey questions either on a computer or over an intercom system with an interviewer. Doing the study in a laboratory isolated the mode effect of computerized self-administered data collection vs. an interview conducted by a human. (more…)
Keep Your Surveys Honest
Wednesday, February 24th, 2010One problem with new survey technologies that make it easy (and inexpensive) to design and field surveys is that we now have an explosion of poorly done and ill-intentioned surveys. Have you ever suspected that a survey isn’t quite legit?
Keeping your survey efforts honest is critical. Sincere efforts to document issues through rigorous surveys succeed, and when done correctly, people are influenced by numbers. But trying to shock or manipulate with sensationalist, biased, and phony data gets you only so far. For a great survey, keep it honest, rigorous, and valid, and carefully control for bias. We, at Versta, can help you succeed with this.
-Joe Hopper, Ph.D.
Recent Findings on Phone vs. Online Surveys
Friday, February 5th, 2010A research article the Winter 2009 issue of Public Opinion Quarterly provided some useful comparisons of data quality between phone surveys and various types of online surveys. The findings are based on an experiment that fielded identical questionnaires via three survey modes, and, not surprisingly, there are strengths and weaknesses to each type of survey.
Phone vs. Online Surveys: Strengths & Weaknesses
As reflected in the table above, the article is rather technical. But there are two key summary points worth learning from the study: (more…)
Forensic Polling Analysis
Thursday, December 17th, 2009Bad pollsters give the market research industry a bad name, so it is encouraging when smart people figure out clever ways of ratting them out. What is a bad pollster? One who makes up data to support an agenda, or who asks biased questions to get preferred answers. The only good reason for doing research or public opinion polling is to learn or share something new. All else is suspect.
Two researchers recently came up with methods of testing whether polling data is legitimate in a case where a research firm is accused of falsifying publicly released data. (more…)
The Walmart “Poll” of Chicago Residents
Tuesday, August 4th, 2009Mistakes to Avoid when Conducting a Public Relations Survey
Surveys and polls can be powerful tools to understand what people are thinking and doing, and they can provide good data for public relations efforts and community outreach. Unfortunately they can also be gimmicks, which erodes trust in polling and in the organizations sponsoring them.