We need to judge the fitness of these panels

Your report on online market research (MW last week) gave a generally balanced view of the issues. It did not, however, identify one major concern – one that is widely overlooked when the merits and shortcomings of online surveys are debated.

Almost all online research is conducted using so-called “panels” of respondents. In contrast to what happens in most “conventional” research, these individuals effectively opt in, even though the better controlled panels seek to obtain their members from a variety of sources. It’s true you can balance the panel by various demographic characteristics, but only within the self-selecting group you start with.

Thus there are two stages of possible bias in the samples selected using online panels – the first due to the fact that perhaps only 60 per cent of people have internet access; and the possibly much greater one caused by the fact that only a small proportion of this 60 per cent are contactable by being members of a panel (or, in some cases, several panels!). We need to know much more about the extent of this second bias and how operators deal with it.

Given that online panels are certain to increase in importance, research users should be encouraged to challenge operators to demonstrate how they set about minimising the effects of this problem.

Roger Gane

Research director

RSMB Audience Research

London WC2

Latest from Marketing Week

NOT REGISTERED? IT'S FREE, QUICK AND EASY!

Access Marketing Week’s wealth of insight, analysis and opinion that will help you do your job better.

Register and receive the best content from the only UK title 100% dedicated to serving marketers' needs.

We’ll ask you just a few questions about what you do and where you work. The more we know about our visitors, the better and more relevant content we can provide for them. And, yes, knowing our audience better helps us find commercial partners too. Don't worry, we won't share your information with other parties, unless you give us permission to do so.

Register now

THE BEST CONTENT

Our award winning editorial team (PPA Digital Brand of the Year) ask the big questions about the biggest issues on everything from strategy through to execution to help you navigate the fast moving modern marketing landscape.

THE BIGGEST ISSUES

From the opportunities and challenges of emerging technology to the need for greater effectiveness, from the challenge of measurement to building a marketing team fit for the future, we are your guide.

PERSONAL AND PROFESSIONAL DEVELOPMENT

Information, inspiration and advice from the marketing world and beyond that will help you develop as a marketer and as a leader.

Having problems?

Contact us on +44 (0)20 7292 3711 or email subscriptions@marketingweek.com

If you are looking for our Jobs site, please click here