Archive for the ‘Public Polls’ Category
Friday, April 26th, 2013
It is hard to find an appropriate use for Google Surveys, because, as we outlined in a review article last fall, its capabilities are limited. But last week we needed a quick incidence test of how many U.S. adults own a certain type of investment product. Google Surveys seemed perfect. It was not fast, by the way. It took five days to collect data from 200 respondents. Google says this is because we asked a screening question before asking about product ownership. Even so, this survey took longer than a standard omnibus.
But what struck me most about my trial run with Google Surveys was the Creepy Factor. It made me realize in a most uncomfortable way that Google tracks everything I do. I knew this already, and I follow ongoing discussions about online privacy. I have a personal g-mail account, a G+ page, and I use Google as the starting point for almost everything I do on the Internet. I know that they track everything I do. But it was never so creepy and apparent until I fielded a Google survey. How was it creepy? (more…)
Tags: ethics, Market Research, omnibus, Online Surveys, privacy, public opinion, Public Polls, survey technology
Posted in Data Collection, Future Trends, Market Research, Methods & Tools, Omnibus Surveys, Online Surveys, Public Polls | No Comments »
Thursday, March 14th, 2013
After leaving academic research for the world of applied research, I found myself doing a lot of surveys for public relations. These surveys are designed to uncover surprising or newsworthy nuggets of data that companies use to focus attention on topics relevant to their concerns. My first boss despised such work, believing that a public relations agenda somehow dirtied the objectivity of rigorous research. In contrast, I love creating these surveys. Why? Let me count the ways:
(more…)
Tags: media, omnibus, Public Relations, stories
Posted in Omnibus Surveys, Public Polls, Public Relations | No Comments »
Thursday, December 27th, 2012
With all our excitement over the last few months about the accuracy of online polling during the election season—substantially outperforming “gold standard” telephone research—there was not time to share ESOMAR’s September 2012 updated guide to purchasing online sample. The guide consists of 28 questions all purveyors of online sample should answer, publish, and make available to every buyer of its products and services. The guide has been updated to reflect rapid changes in online sampling over the last couple of years, including use of routers, real-time sampling, and blended sample from multiple sources.
Before purchasing online sample for your next research survey, be sure that you know the answers to these 28 questions: (more…)
Tags: online, Online Panels, Online Surveys, panels, Public Polls, Sampling
Posted in Data Collection, Market Research, Online Surveys, Public Polls, Resources and Recommendations, Sampling | No Comments »
Thursday, November 29th, 2012
If there is one super important lesson to be learned from this year’s round of election polling, it is that online surveys work. Google Consumer Surveys, which use non-probability online samples, predicted the election far better than Gallup did. And online surveys, overall, outperformed telephone surveys.
The New York Times’ Nate Silver compiled polling results from 23 organizations that conducted at least five surveys in the final three weeks of the campaign. He calculated how far their projections were from the actual outcome of the presidential race. Google (a fully automated, online solution) came in second place, predicting the actual outcome within 1.6 percentage points. Gallup (using “gold standard” telephone methods) came in last, predicting the outcome within 7.2 percentage points.
(more…)
Tags: Online Surveys, phone surveys, Public Polls
Posted in Data Collection, Future Trends, Market Research, Methods & Tools, Online Surveys, Public Polls, Public Relations | No Comments »
Wednesday, November 14th, 2012
I have never been a media poll watcher or politics junkie who tracks every new poll saying which candidate is favored to win. It is hard to see the point of spending so much time and money predicting the outcome of an event that will be known with certainty within a matter of days, weeks, or months. But elections are an amazing way to see survey research methods in action, and there are few opportunities to have those methods validated so quickly, accurately, and unforgivingly than political polling.
What did we learn from the polls this election season? (more…)
Tags: methods, models, Online Surveys, phone surveys, Public Polls, research, statistics, survey
Posted in Future Trends, Market Research, Public Polls | No Comments »
Wednesday, November 7th, 2012
What IS a credibility interval, you ask? It is a term making its way into mainstream market research just as Bayesian statistics are making their way into market research. A credibility interval provides a range of values, calculated using Bayesian statistical techniques, within which a statistical estimate is likely to fall. It is analogous to a confidence interval, which is the traditional and commonly used measure of sampling error in survey research and statistical estimation.
As with a confidence interval, a credibility interval can be a legitimate, compelling, and mathematically rigorous way of expressing the certainty of statistical estimates. Unfortunately it is being used in the same sloppy, inappropriate, and misleading ways that confidence interval and “margins of error” are being used. (more…)
Tags: confidence intervals, margin of error, statistics
Posted in Data Analysis & Analytics, Future Trends, Market Research, Online Surveys, Public Polls | No Comments »
Thursday, October 18th, 2012
Six months ago Google launched an intriguing new way to conduct cost-effective surveys that offers an alternative to omnibus surveys. One or two easy survey questions are presented to online users as they seek access to high quality media sites. They gain free access in exchange for answering the survey questions. Google tracks how many people are answering each question and manages the process to ensure that the sample of respondents answering each question closely matches the overall U.S. population (based on Census data for those who have Internet access).
Here are some of the more interesting aspects of their approach: (more…)
Tags: omnibus, Online Panels, Online Surveys, Public Polls
Posted in Data Collection, Future Trends, Methods & Tools, Omnibus Surveys, Online Surveys, Public Polls | No Comments »
Friday, September 21st, 2012
During a presidential election year there is no escaping the flurry of public opinion polling and the intense scrutiny that surveys get from the media. But love it or hate it, there are excellent reasons to pay close attention to this year’s political polling.
(more…)
Tags: best practices, journalism, media, methods, news, phone surveys, public opinion, Public Polls, Public Relations, Sampling, survey, Survey Design
Posted in Data Collection, Future Trends, Market Research, Methods & Tools, Public Polls, Public Relations, Sampling, Survey Design | No Comments »
Thursday, August 23rd, 2012
Way back in 1944, Edwards Deming published an article in the American Sociological Review that could be required reading for anybody who does research today. He outlined all potential (and unfortunately, common) sources of error in survey research.
Apparently our contemporary obsession with sample sizes, random samples, response rates, and margins of error is not so new. In outlining all sources of error, Demining wanted to emphasize that “sampling errors, even for small samples, are often the least of the errors present.”
So despite some old-fashioned language and defunct technologies (Versta Research has never fielded a survey via telegraph!) we feel it is worth reproducing here what Deming called the thirteen factors “affecting the ultimate usefulness of a survey” as all of them apply as much today as they did 68 years ago:
(more…)
Tags: bias, margin of error, Online Surveys, response rates, Sampling, survey, Survey Design
Posted in Data Analysis & Analytics, Data Collection, Market Research, Public Polls, Sampling, Survey Design | No Comments »
Thursday, August 2nd, 2012
Is this YOUR distracted survey respondent?
A couple weeks ago we presented new data showing that response rates continue to decline. You can now expect that a typical, rigorously executed phone survey will yield a response rate in the single digits.
Scientific evidence over the last decade has shown that high response rates do not necessarily yield more accurate surveys. In fact, it turns out that high response rates can actually hurt the accuracy of surveys.
(more…)
Tags: Online Surveys, phone surveys, response rates, Sampling, survey, survey respondents
Posted in Data Collection, Market Research, Methods & Tools, Online Surveys, Public Polls | No Comments »