After leaving academic research for the world of applied research, I found myself doing a lot of surveys for public relations. These surveys are designed to uncover surprising or newsworthy nuggets of data that companies use to focus attention on topics relevant to their concerns. My first boss despised such work, believing that a public relations agenda somehow dirtied the objectivity of rigorous research. In contrast, I love creating these surveys. Why? Let me count the ways:
During a presidential election year there is no escaping the flurry of public opinion polling and the intense scrutiny that surveys get from the media. But love it or hate it, there are excellent reasons to pay close attention to this year’s political polling.
Journalists and newsrooms are inundated with ever more data, information, and press releases that highlight survey findings in hopes of grabbing reporters’ and readers’ interest. While many surveys are poorly done and grossly self-serving, findings from other research surveys continue to generate newsworthy stories.
Consider this view recently expressed by a business columnist at the Chicago Tribune:
Election years are a perfect time to learn about (and brush up on) the fundamentals of survey research. Not only are the airwaves inundated with public opinion polling, but methodological experts are called upon to talk about developments and current best practices as new technologies and methods become central to measuring consumer and public opinion and behavior.
This week the Poynter Institute is offering a webinar of particular interest for PR professionals, whether or not you care about political polls. We also recommend it for any marketing professional because this type of polling is an exemplar of what all marketing research tries to achieve in measuring what people think and what they are likely to do. (more…)
One powerful way to gain visibility and credibility in your marketplace is by sponsoring survey research that documents problems and solutions in areas where you have expertise. To be successful, it requires (1) rigorous research carefully designed to uncover the right topics, and (2) savvy PR work that uses data to tell a credible and compelling story.
The Public Relations Society of America (PRSA) and the American Statistical Association have just published a handy guide for PR professionals that outlines best practices for using, interpreting and reporting statistics in press releases and other PR materials. Some of those best practices include the following: (more…)
A new study presented by two professors from Harvard University and the University of Massachusetts at Amherst was probably one of the liveliest and potentially disruptive presentations at least week’s annual meeting of the American Association of Public Opinion Research (AAPOR) in Phoenix.
Why? Because their research challenges the beliefs of many AAPOR-ites who disregard most online research as being theoretically indefensible since it is not based on probability sampling. The research presented was based on parallel surveys conducted last year, designed to allow careful comparison of three survey modes: (more…)
As much as we love numbers, we find ourselves often advising clients against using numeric scales in their surveys. A numeric scale is any response format that asks people to give a number within a certain range to indicate the strength of their feeling or opinion. The insanely popular survey question used to calculate Net Promoter Scores is a good example:
“How likely is it that you would recommend Acme Solutions to a friend or colleague? Please answer on a scale from zero to ten, where zero means not at all likely, five is a neutral score, and ten means extremely likely.”
There are many good reasons to use numeric scales and many types of research for which numeric scales are optimal. The NPS scale is good because it has eleven points with meaningful endpoints and a meaningful midpoint. Research shows that scales like this can be highly reliable and valid, with sufficient variability to allow for sophisticated statistical modeling.
But if your objective is to use survey data for marketing materials, public relations, news releases, or white papers, numeric scales make things difficult. They are not easy to summarize in words, and if you want to use charts that tell quick, compelling stories, you will end up having to do something like this:
A Poor Fit: Pie Charts and Numeric Scales
After spending $65 million and previewing the show over sixty times since the end of last year, the producers of the new Spider-Man musical in New York are turning to focus groups and surveys in hopes that market research can do something…anything…to save the amazing Spider-Man from destruction.
Last week, theater critics roundly panned the show, calling it among the worst Broadway shows ever. The New York Times described is as “so grievously broken in every respect that it is beyond repair.” But days after these negative reviews, a market research firm was brought in, soliciting volunteers to help fix the show: (more…)
Research can be powerful for PR efforts because new data and analysis often help anchor a story with facts and figures that have a deep interest and appeal to readers. But if the research is not clearly designed to support key messages in your PR plan, you may find yourself apologizing to managers for a campaign that failed. Worse yet, you may find yourself apologizing to an audience who got exactly the wrong message.
Last week, Allstate found itself in this unhappy situation when it released findings from “research” showing accident rates based on drivers’ astrological signs. (more…)