Posts Tagged ‘media’

Webinar on Polling for News and PR

Tuesday, January 24th, 2012

Election years are a perfect time to learn about (and brush up on) the fundamentals of survey research.  Not only are the airwaves inundated with public opinion polling, but methodological experts are called upon to talk about developments and current best practices as new technologies and methods become central to measuring consumer and public opinion and behavior.

This week the Poynter Institute is offering a webinar of particular interest for PR professionals, whether or not you care about political polls.  We also recommend it for any marketing professional because this type of polling is an exemplar of what all marketing research tries to achieve in measuring what people think and what they are likely to do. (more…)

Best Practices for Using Statistics in PR

Wednesday, November 9th, 2011

One powerful way to gain visibility and credibility in your marketplace is by sponsoring survey research that documents problems and solutions in areas where you have expertise.  To be successful, it requires (1) rigorous research carefully designed to uncover the right topics, and (2) savvy PR work that uses data to tell a credible and compelling story.

The Public Relations Society of America (PRSA) and the American Statistical Association have just published a handy guide for PR professionals that outlines best practices for using, interpreting and reporting statistics in press releases and other PR materials.  Some of those best practices include the following: (more…)

Online Surveys Have Same Accuracy as Phone

Thursday, May 26th, 2011

A new study presented by two professors from Harvard University and the University of Massachusetts at Amherst was probably one of the liveliest and potentially disruptive presentations at least week’s annual meeting of the American Association of Public Opinion Research (AAPOR) in Phoenix.

Why?  Because their research challenges the beliefs of many AAPOR-ites who disregard most online research as being theoretically indefensible since it is not based on probability sampling.  The research presented was based on parallel surveys conducted last year, designed to allow careful comparison of three survey modes:  (more…)

Advice for PR Surveys: Avoid Numeric Scales

Thursday, April 28th, 2011

As much as we love numbers, we find ourselves often advising clients against using numeric scales in their surveys.  A numeric scale is any response format that asks people to give a number within a certain range to indicate the strength of their feeling or opinion.  The insanely popular survey question used to calculate Net Promoter Scores is a good example:

“How likely is it that you would recommend Acme Solutions to a friend or colleague?  Please answer on a scale from zero to ten, where zero means not at all likely, five is a neutral score, and ten means extremely likely.”

There are many good reasons to use numeric scales and many types of research for which numeric scales are optimal.  The NPS scale is good because it has eleven points with meaningful endpoints  and a meaningful midpoint.  Research shows that scales like this can be highly reliable and valid, with sufficient variability to allow for sophisticated statistical modeling.

But if your objective is to use survey data for marketing materials, public relations, news releases, or white papers, numeric scales make things difficult.  They are not easy to summarize in words, and if you want to use charts that tell quick, compelling stories, you will end up having to do something like this:

A Poor Fit: Pie Charts and Numeric Scales

(more…)

Can a Focus Group Save Spider-Man?

Wednesday, February 16th, 2011

After spending $65 million and previewing the show over sixty times since the end of last year, the producers of the new Spider-Man musical in New York are turning to focus groups and surveys in hopes that market research can do something…anything…to save the amazing Spider-Man from destruction.

Last week, theater critics roundly panned the show, calling it among the worst Broadway shows ever. The New York Times described is as “so grievously broken in every respect that it is beyond repair.”  But days after these negative reviews, a market research firm was brought in, soliciting volunteers to help fix the show: (more…)

Allstate’s PR Misstep with a Silly Study

Friday, February 4th, 2011

Research can be powerful for PR efforts because new data and analysis often help anchor a story with facts and figures that have a deep interest and appeal to readers.  But if the research is not clearly designed to support key messages in your PR plan, you may find yourself apologizing to managers for a campaign that failed.  Worse yet, you may find yourself apologizing to an audience who got exactly the wrong message.

Last week, Allstate found itself in this unhappy situation when it released findings from “research” showing accident rates based on drivers’ astrological signs. (more…)

Killer Quotes from Research Respondents

Thursday, November 11th, 2010

One way you can make a research report really pop is to carefully select and edit quotes from the people involved in the study.  For qualitative research, that means pulling quotes from transcripts of in-depth interviews, focus groups, online bulletin boards, social media, etc.  For survey research, it means pulling quotes from open-ended questions that were recorded verbatim.

Editing is key, however.  Who wants to read something in the halting, choppy, in-eloquent speech that most of us use in talking?  A killer quote is one that is short, direct, pithy, and on point.  Achieving this requires a journalistic standard for presenting quotes.  What does that mean?  Here are some steps: (more…)

Eliminate Your Margin of Error

Thursday, October 14th, 2010

Should you state a survey’s margin of error in your press release when pitching a story to the media?  In our view, the answer is no.  Why not?  Because margins of error refer to sampling error only, not about the overall accuracy or error of the survey itself.

But how many readers of your news story understand what sampling error is?  For that matter, how many researchers understand what sampling error is?  It was only after four college semesters of advanced mathematical statistics that I finally “got it.”  More importantly, how many readers understand that there are many other potential sources of survey error?  Most undoubtedly assume that all error is somehow accounted for when you confidently proclaim the margin of error being ±4%.  (Or, more absurdly, ±3.6% or even ±3.57% — examples of phony accuracy like this are all too easy to find.)

In short, margins of error are misleading because they deal with only one source of error.  They convey a false sense of accuracy.  And they should not be used.  This idea is not always popular among colleagues and clients.  But take comfort:  One of the giants of public polling, Harris Interactive, refuses to report margins of error in its work, for precisely the reasons outlined above.  Here we quote their methodological statement that accompanies every press release and report they issue: (more…)

Why You Need a Partisan Pollster

Friday, September 17th, 2010

In an op-ed column two days ago, Stuart Rothenberg, a prominent political (and non-partisan) commentator argued that partisan pollsters (those who work directly for either Democratic or Republican candidates) do a better job than presumably objective third party pollsters.  Why?  Because they have to get it right.  Their campaign strategies depend on it.  Quoting Mr. Rothenberg: (more…)

Optimize Your PR—Don’t Do Silly Surveys

Wednesday, August 25th, 2010

We are strong advocates of using surveys for public relations outreach.  Commissioning surveys that answer interesting questions to help drive news stories and other types of communication can build a credible foundation so that journalists and other audiences take note and listen.  But we are not fans of silly surveys that rely on outlandish, sexy, or clever comparisons designed primarily to get quick flashes of attention and media hits.

There are three tiers of survey research common in public relations, only two of which can truly optimize your PR: (more…)