Posts Tagged ‘Data Collection’
Wednesday, December 7th, 2011
In Versta Research’s Winter 2011 Newsletter, published just this week, we describe a simple method for estimating how long it will take respondents to complete surveys.
Here we offer the “Versta Digest” version as a handy reference card. Once you get the hang of it, you don’t need the examples and explanation. You just need to know the rules. We recommend reading the full article first, so you know what we’re talking about when it comes to “points.” Then, when you need a refresher or a reference source, consult these rules: (more…)
Tags: Data Collection, Online Surveys, phone surveys, research, Survey Design
Posted in Data Collection, Methods & Tools, Online Surveys, Survey Design | No Comments »
Thursday, September 29th, 2011
Is it true that the Associated Press refuses to carry stories from online surveys? Yes, as odd as that seems nowadays. But news media face a difficult problem given how easy it is to conduct biased public opinion polling, especially now with online panels and social networks. So some news organizations like the Associated Press (AP), The New York Times, and ABC News have developed guidelines that specify for a survey or public opinion poll to be valid and reliable, it must be conducted by telephone.
(more…)
Tags: Data Collection, Internet, journalism, omnibus, Online Surveys, phone surveys, public opinion, Public Polls, Public Relations, Sampling
Posted in Data Collection, Omnibus Surveys, Online Surveys, Public Polls, Public Relations, Sampling | No Comments »
Thursday, September 22nd, 2011
Two researchers at the U.S. Census Bureau recently outlined an emerging innovation in survey research that could reverse the trend towards passive, boring, self-administered surveys that characterizes much online research. The idea is to use internet avatars in real-time interviewing with survey respondents.
Beyond just the heightened interest of having an animated survey, the avatars would be programmed to register and interpret respondents’ verbal answers, facial expressions, and body language through webcams.
(more…)
Tags: Data Collection, insight, Internet, Market Research, Online Surveys, stories, survey technology
Posted in Data Collection, Future Trends, Market Research, Methods & Tools, New Products and Innovation, Online Surveys | No Comments »
Friday, August 19th, 2011
The most recent government estimates of cell phone usage among U.S. households were released a few weeks back, and the pace at which landline usage is disappearing is astonishing. Here are just some of the numbers:
- Thirty percent of U.S. households do not have a landline telephone
- An additional 16% have a landline telephone, but never or rarely use it to receive calls
- The percentage of households without landlines is increasing by about five to six percentage points each year
- Half of young adults under age 30 have no landline in their homes
- Half of adult renters have no landline in their homes
- Nearly four out of ten Hispanic adults have no landline in their homes
(more…)
Tags: consumer behavior, Data Collection, Internet, Market Research, phone surveys, Public Polls, Sampling, social media, survey technology
Posted in Data Collection, Future Trends, Market Research, Public Polls, Sampling | No Comments »
Tuesday, August 9th, 2011
These days most researchers agree that if you want to do a random sample phone survey of the U.S. population, you ought to include cell phones. More than one-quarter of the population do not have landline telephones at home. Those who do have landline telephones are less likely than ever to answer them, and less likely than ever to participate in surveys.
But it is not easy to include cell phones. The sampling protocols and the post-stratification weighting become more complicated. You need to account for a higher probability of cell phone owners being in your sample, because most of them also have landlines. You can’t use automated or predictive dialing to call cell phone numbers. You can’t target geography as well, because area codes and exchanges have become mobile. And people get mad at you if they have to pay for incoming calls, so you need to offer cash.
What’s the bottom line effect on costs for a survey that includes cell phones? A recent study sponsored by the American Association for Public Opinion Research (AAPOR) documents the following: (more…)
Tags: bias, Data Collection, Market Research, phone surveys, population, public opinion, Public Polls, research, Sampling
Posted in Data Collection, Future Trends, Market Research, Public Polls, Sampling | No Comments »
Wednesday, June 29th, 2011
One of the surprises of multi-mode research is that offering people a choice of how they want to complete a survey (online, by mail, by phone, etc.) does not necessarily boost response rates. An article in the most recent issue of Public Opinion Quarterly provides new evidence of this. The study showed that even in a population with full access to both mail and Internet options (and full literacy in both modes), a full mail survey achieves a higher response rate than a web-based survey. It also achieves a higher response rate than a choice of either mail or web. So much for our recent article on The Myth of Too Many Choices!
But the study went further to explore some ways of sequentially deploying multiple survey options and multiple modes of information that can substantially boost web-based survey response rates. Here are some key takeaways from the research: (more…)
Tags: Data Collection, Internet, Online Surveys, response rates, survey, survey respondents
Posted in Data Collection, Online Surveys, Survey Tips | No Comments »
Thursday, May 26th, 2011
A new study presented by two professors from Harvard University and the University of Massachusetts at Amherst was probably one of the liveliest and potentially disruptive presentations at least week’s annual meeting of the American Association of Public Opinion Research (AAPOR) in Phoenix.
Why? Because their research challenges the beliefs of many AAPOR-ites who disregard most online research as being theoretically indefensible since it is not based on probability sampling. The research presented was based on parallel surveys conducted last year, designed to allow careful comparison of three survey modes: (more…)
Tags: bias, census, Data Collection, Internet, journalism, media, news, Online Surveys, phone surveys, public opinion, Public Polls, Public Relations, Sampling
Posted in Data Collection, Methods & Tools, Online Surveys, Public Polls, Public Relations, Sampling | No Comments »
Thursday, May 12th, 2011
We are often surprised by the number of senior researchers in the market research industry who never touch raw data. Often they don’t even have the tools, since “data processing” is outsourced to lower levels or other countries. It is surprising because we almost always engage in work where getting into the data and puzzling over anomalies or hypotheses yields much deeper insight.
Here is an example of how critical it can be to look closely at your data, and in this case, very early in the data collection process. We launched an online survey last week and got reports back from our sample supplier that incidence was just one-third of what we expected, which would have serious feasibility and cost implications.
But once we looked at their report portal, we saw that for every qualified respondent completing the survey, two qualified respondents quit before finishing. That’s an unusually high ratio of “suspends” as we call them. So what was the problem? Were we just getting lousy respondents who did not want to seriously participate in a survey? Was the survey was too difficult, tedious, boring, or confusing? One source of answers (rarely examined) is to look at the data question by question to identify where in the survey people are quitting.
The story in this data: Something is wrong with your survey
(more…)
Tags: data, Data Collection, data quality, insight, research, stories, survey, survey respondents
Posted in Charts and Data Visualization, Data Analysis & Analytics, Data Collection, Methods & Tools, Survey Design | No Comments »
Thursday, April 28th, 2011
As much as we love numbers, we find ourselves often advising clients against using numeric scales in their surveys. A numeric scale is any response format that asks people to give a number within a certain range to indicate the strength of their feeling or opinion. The insanely popular survey question used to calculate Net Promoter Scores is a good example:
“How likely is it that you would recommend Acme Solutions to a friend or colleague? Please answer on a scale from zero to ten, where zero means not at all likely, five is a neutral score, and ten means extremely likely.”
There are many good reasons to use numeric scales and many types of research for which numeric scales are optimal. The NPS scale is good because it has eleven points with meaningful endpoints and a meaningful midpoint. Research shows that scales like this can be highly reliable and valid, with sufficient variability to allow for sophisticated statistical modeling.
But if your objective is to use survey data for marketing materials, public relations, news releases, or white papers, numeric scales make things difficult. They are not easy to summarize in words, and if you want to use charts that tell quick, compelling stories, you will end up having to do something like this:
A Poor Fit: Pie Charts and Numeric Scales
(more…)
Tags: charts, communication, Data Collection, journalism, media, news, omnibus, Public Relations, stories, Survey Design, visualizing data
Posted in Charts and Data Visualization, Data Collection, Omnibus Surveys, Presenting Research, Public Relations, Survey Design, Survey Tips, Turning Data into Stories | No Comments »
Saturday, April 16th, 2011
Among the many sources of potential error that can affect surveys are respondents themselves. They sometimes misinterpret questions, respond in socially acceptable ways, or give “easy” answers in hopes that a more interesting question is just around the corner.
This is not to say they are bad or fraudulent respondents. Research shows that the vast majority of survey respondents are careful, thoughtful, and truthful in how they answer survey questions. The problem with respondent error, it turns out, is poor survey design, which may involve biased or ambiguous questions, tasks that are too complicated or boring, surveys that are too long, and so on.
Recent research shows that grid-style questions that look like this:
or this: (more…)
Tags: bias, Data Collection, data quality, Market Research, Online Surveys, Survey Design, survey respondents
Posted in Data Collection, Market Research, Methods & Tools, Online Surveys, Survey Design, Survey Tips | No Comments »
