Archive for the ‘Data Collection’ Category
Wednesday, January 18th, 2012
Many of us in marketing research have been deploying web surveys for over ten years, and web surveys are, by far, the dominant mode of data collection in our industry nowadays. But our techniques and methods are an amalgam of practices adapted from other data collection modes, learned in part through trial and error, and taught to others through channels more akin to oral traditions. So it is helpful when our academic colleagues manage to document and codify the art and science of what we do. (more…)
Tags: bias, Internet, Market Research, Online Surveys, Sampling, statistics, Survey Design
Posted in Data Analysis & Analytics, Data Collection, Market Research, Online Surveys, Resources and Recommendations, Sampling, Survey Design | No Comments »
Wednesday, December 7th, 2011
In Versta Research’s Winter 2011 Newsletter, published just this week, we describe a simple method for estimating how long it will take respondents to complete surveys.
Here we offer the “Versta Digest” version as a handy reference card. Once you get the hang of it, you don’t need the examples and explanation. You just need to know the rules. We recommend reading the full article first, so you know what we’re talking about when it comes to “points.” Then, when you need a refresher or a reference source, consult these rules: (more…)
Tags: Data Collection, Online Surveys, phone surveys, research, Survey Design
Posted in Data Collection, Methods & Tools, Online Surveys, Survey Design | No Comments »
Wednesday, November 23rd, 2011
Versta Research is a strong advocate for using online panels for surveys. As telephone usage and technology have changed, phone surveys are increasingly difficult and expensive, and they are not necessarily more rigorous than other methods.
But that doesn’t mean “anything goes” when it comes to fielding market research surveys and public opinion polls through online panels. Many panels are poorly managed and overused, and some have high proportions of fraudulent respondents. While conducting good research through online panels is possible, it requires a great deal of effort and oversight from smart people who know what they are doing.
I was reminded of this recently as we worked with a newer panel provider that recruits respondents through not-for-profit organizations. (more…)
Tags: Internet, Online Panels, Online Surveys, Sampling, social media
Posted in Data Collection, Market Research, Methods & Tools, Online Surveys, Sampling | No Comments »
Thursday, October 20th, 2011
Earlier this month Arthur C. Nielsen, Jr. died. He left behind a giant and reputable market research company and a brand name recognized throughout the world. The A.C. Nielsen company was started by his father and in its early years tracked the sales of goods through grocery and drug stores. The company then moved into media tracking and became the authoritative source for measuring audience size and demographics. Nearly every company with an advertising budget continues to rely on Nielsen data to determine where to advertise and how much to spend.
Nielsen’s legacy is that he demonstrated the value of collecting and tracking data, and lots of it. Every item we purchase is now logged, counted, and tracked. Every television and radio show is tracked for how many viewers it has and in what markets they live. And of course everything we do on the Internet is recorded and tracked. Even our bodily locations are tracked via GPS or cell phone signals. Most market research firms today generate the bulk of their revenue simply by collecting, tracking, tabulating, and reporting data.
This important legacy has left us with tons of data, growing at an exponential rate, and a monumental challenge of how to synthesize it and move beyond mere tabulation and reporting. The question is, how do we meet that challenge and take Nielsen’s legacy to the next frontier? In our view, it will involve two key efforts:
(more…)
Tags: analytics, communication, data, insight, Market Research, stories, tracking studies
Posted in Data Analysis & Analytics, Data Collection, Future Trends, Market Research, Turning Data into Stories | No Comments »
Wednesday, October 5th, 2011
In response to last week’s newsletter, Is Your Research Good Enough for The New York Times?, which discussed hurdles of getting online survey research reported by some news organizations, a customer reminded us that online surveys can be difficult to sell internally as well. Too many people have been burned by junk data from online surveys.
One problem with online panels is that some respondents (a small minority) participate only to get paid in cash or redeemable credits. If these respondents are not providing thoughtful answers, the data are suspect. All panels have the problem, though some are worse than others; reputable sample providers work hard to identify and remove fraudulent respondents from their panels.
But we should not rely on panel providers alone to ensure valid data. Buyers of panel surveys should always look at the data case by case to identify and remove suspicious cases. Here are typical indicators of potentially bad data:
(more…)
Tags: data quality, Online Surveys, open-ends, survey respondents
Posted in Data Collection, Methods & Tools, Online Surveys, Survey Tips | No Comments »
Thursday, September 29th, 2011
Is it true that the Associated Press refuses to carry stories from online surveys? Yes, as odd as that seems nowadays. But news media face a difficult problem given how easy it is to conduct biased public opinion polling, especially now with online panels and social networks. So some news organizations like the Associated Press (AP), The New York Times, and ABC News have developed guidelines that specify for a survey or public opinion poll to be valid and reliable, it must be conducted by telephone.
(more…)
Tags: Data Collection, Internet, journalism, omnibus, Online Surveys, phone surveys, public opinion, Public Polls, Public Relations, Sampling
Posted in Data Collection, Omnibus Surveys, Online Surveys, Public Polls, Public Relations, Sampling | No Comments »
Thursday, September 22nd, 2011
Two researchers at the U.S. Census Bureau recently outlined an emerging innovation in survey research that could reverse the trend towards passive, boring, self-administered surveys that characterizes much online research. The idea is to use internet avatars in real-time interviewing with survey respondents.
Beyond just the heightened interest of having an animated survey, the avatars would be programmed to register and interpret respondents’ verbal answers, facial expressions, and body language through webcams.
(more…)
Tags: Data Collection, insight, Internet, Market Research, Online Surveys, stories, survey technology
Posted in Data Collection, Future Trends, Market Research, Methods & Tools, New Products and Innovation, Online Surveys | No Comments »
Friday, August 19th, 2011
The most recent government estimates of cell phone usage among U.S. households were released a few weeks back, and the pace at which landline usage is disappearing is astonishing. Here are just some of the numbers:
- Thirty percent of U.S. households do not have a landline telephone
- An additional 16% have a landline telephone, but never or rarely use it to receive calls
- The percentage of households without landlines is increasing by about five to six percentage points each year
- Half of young adults under age 30 have no landline in their homes
- Half of adult renters have no landline in their homes
- Nearly four out of ten Hispanic adults have no landline in their homes
(more…)
Tags: consumer behavior, Data Collection, Internet, Market Research, phone surveys, Public Polls, Sampling, social media, survey technology
Posted in Data Collection, Future Trends, Market Research, Public Polls, Sampling | No Comments »
Tuesday, August 9th, 2011
These days most researchers agree that if you want to do a random sample phone survey of the U.S. population, you ought to include cell phones. More than one-quarter of the population do not have landline telephones at home. Those who do have landline telephones are less likely than ever to answer them, and less likely than ever to participate in surveys.
But it is not easy to include cell phones. The sampling protocols and the post-stratification weighting become more complicated. You need to account for a higher probability of cell phone owners being in your sample, because most of them also have landlines. You can’t use automated or predictive dialing to call cell phone numbers. You can’t target geography as well, because area codes and exchanges have become mobile. And people get mad at you if they have to pay for incoming calls, so you need to offer cash.
What’s the bottom line effect on costs for a survey that includes cell phones? A recent study sponsored by the American Association for Public Opinion Research (AAPOR) documents the following: (more…)
Tags: bias, Data Collection, Market Research, phone surveys, population, public opinion, Public Polls, research, Sampling
Posted in Data Collection, Future Trends, Market Research, Public Polls, Sampling | No Comments »
Wednesday, June 29th, 2011
One of the surprises of multi-mode research is that offering people a choice of how they want to complete a survey (online, by mail, by phone, etc.) does not necessarily boost response rates. An article in the most recent issue of Public Opinion Quarterly provides new evidence of this. The study showed that even in a population with full access to both mail and Internet options (and full literacy in both modes), a full mail survey achieves a higher response rate than a web-based survey. It also achieves a higher response rate than a choice of either mail or web. So much for our recent article on The Myth of Too Many Choices!
But the study went further to explore some ways of sequentially deploying multiple survey options and multiple modes of information that can substantially boost web-based survey response rates. Here are some key takeaways from the research: (more…)
Tags: Data Collection, Internet, Online Surveys, response rates, survey, survey respondents
Posted in Data Collection, Online Surveys, Survey Tips | No Comments »
