Archive for the ‘Survey Tips’ Category

Writing Successful Omnibus Survey Questions

Friday, May 14th, 2010

Choosing an omnibus survey can be a simple approach to getting survey data, because it is usually inexpensive and fast, and involves asking just a few questions.  But there is sometimes a downside to simplicity:  You have just a few questions to get that nugget of data you’re hoping to use as a news hook or to provide insight to your client.  If your key questions are off target, you can’t turn to other content in your survey to find something usable.

Here are four tips for writing omnibus survey questions to ensure that your effort is successful: (more…)

How Long Should a Survey Be?

Friday, April 23rd, 2010

Asking people to fill out long, tiresome, and boring surveys is a scourge of the research, polling, and survey industry.  (Another is asking them to fill out a survey every time they interact with you — see There Are Too Many Surveys.)  Asking people to fill out long surveys teaches them to avoid surveys in the future, and indeed we see survey participation rates continuing to decline.  But more importantly if you are the one who needs to rely on survey data, long surveys result in measurably lower data quality. (more…)

The Art of Asking Questions

Friday, March 19th, 2010

This quarter’s newsletter from Versta Research focuses on the art of asking questions.  We suggest that the importance of business questions far exceeds the importance of survey questions or focus group questions.  You can’t do the latter without the former, at least not very well, and research that is not specifically designed to answer clearly articulated business questions usually falls flat.

Here are some great quotes we found to keep in mind as guiding principles: (more…)

When to Kick Out a Survey Respondent

Thursday, March 4th, 2010

Nearly every survey begins with screening questions to ensure that only the people you are trying to reach are included in the survey.  For example, if you are conducting a survey of women, you need to ask about gender and kick out the men.  And because every question costs money, you want to qualify respondents quickly and terminate those who do not belong.

Here is a helpful hint: Do not actually terminate respondents until after you have asked all screening questions.  (more…)

There Are Too Many Surveys

Thursday, November 12th, 2009

You might think that a research firm specializing in surveys would be glad to see a world in which customer feedback surveys are everywhere.  Not so.  I take part in a lot of webinars, and unfortunately I am asked to complete a survey (at least one) every time I attend.  Some websites ask me to evaluate my experience every time I go there.  Some companies ask me to evaluate my customer service call every time I call with a question or complaint.  The companies asking me to complete these surveys are convinced by pitches like this:  “The real power of [our survey tool] can only be unlocked through a commitment to continuous listening.  Listening to your visitors is truly a process, not an event. Continuous surveying can help you to establish benchmarks and trend your performance on key metrics.” (more…)

Focus on Solutions in PR Surveys

Wednesday, September 30th, 2009

A public relations client early in my career gave this assessment of my work:  “Joe is strong at highlighting problems, but what I really care about is solutions.”  That was many years ago, after I left university teaching and started doing client work full time.  Her words have stayed with me and deeply shaped the work that Versta does.

I was reminded of it when I came across this survey about fear of needles.  It reports statistics on how many are fearful of needles and avoiding medical care as a result.  But it’s a story begging for a conclusion, which the press release authors and survey designers forgot to include.  It is a good example of highlighting problems, but not offering solutions.  If you’re a motivated reader of that story, you can fill in the conclusion by reading the paragraph at the bottom about the sponsoring healthcare company’s business, but how many people read that, and how often does such information make it into a story picked up by the press? (more…)

Better Data through Better Survey Design

Monday, September 14th, 2009

Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses.

But the problem is rarely “bad respondents” – instead the problem is lazy researchers.  When people discover that the survey they just agreed to take is boring, tedious, repetitive, or too long, they either quit altogether or they stop providing good answers.

(more…)

Three Ways to Improve Online Verbatim Data

Wednesday, August 19th, 2009

Good open-ended questions and thoughtful responses to these questions can yield amazingly rich and insightful data.  But given the generally poor quality of responses to open-ended question in mail surveys, some have speculated that open-ended questions in online surveys would suffer a similar fate.

Research seems to show this is not the case.  Further, a study just published in the Summer 2009 issue of Public Opinion Quarterly outlines three ways that we can improve the quality of responses in on-line surveys:

(more…)