The Problem of Bias

If your market research is biased, it will lead to bad decisions.
What can you do about it?

Bias distorts truth. It interferes with our ability to truly understand the environments around us. It is the most challenging obstacle for market researchers. Reaching the pinnacle of objectivity is not an easy task, but there are steps you can take to minimize the bias that is present in research by going directly to the ‘source’, users and decision makers.

What’s so Bad About Bias?

But what makes bias so bad? We all have opinions, which are a form of inherent bias. However, bias can be relatively manageable when it’s known and understood, but it becomes a major impediment to objectivity when it is not recognized.

Awareness is everything. If you are unconscious of your bias, it will creep into your research study. On the other hand, if you understand your subjectivity, you can overcome it, if you take the right steps.

 

Forms of Bias

Bias in market research can come in various forms but there are four that stand out as primary roadblocks:

The researcher can manage all these biases except proxies. In this scenario, you effectively turn your market research over to a third-party and blindly trust that their studies are constructed to truly support your unique needs. This creates a major disconnect. Without direct access to the analysts and consultants who are doing research on your behalf, it is impossible to uncover and validate/invalidate their assumptions.

As a result, researchers should go directly to the ‘source’. They must speak directly to customers practitioners, and users to obtain data that can enable smart decision-making. The ‘source’ has their own biases, but the researcher can ask precise questions to analyze assumptions and/or demographics derived from bias and thus validate/invalidate the source as appropriate data.

You Could Be Your Own Bias

In the same vein, researchers should consider their own biases when developing a research vehicle. Does the respondent know you? If yes, the respondent might answer differently in tone, manner or even context than if they had talked to a stranger. Therefore, it is usually better to survey or interview ‘blinded’ respondents to ensure that filters are kept to a minimum.

Bias Inherent in the System

Surveys and interview guides can have their own biases, particularly in the method and flow of questions. Researchers need to be careful in crafting these tools, as they can influence the respondent in ways that may distort the ‘truth’.

For example, a question like “How bad are market conditions?” suggests that marketing conditions are poor, forcing the respondent to answer from that perspective, resulting in an ‘echo chamber’ that needlessly reinforces bias. Researchers should instead ask, “What are current market conditions?” which allows the respondent to answer from their point of view.

Lies, Damned Lies, and Statistics

Lastly, bias can come during the “analysis phase,” when the researcher pulls out the most significant data points, synthesizes it into ‘meaningful’ insights, and presents these insights to an audience. Communication of insights can lead to misinterpretation. The best way to neutralize these biases is to articulate underlying assumptions along the way and to ensure that the audience understands how these assumptions inform the insights.

The key to good research is to go to the ‘source’, avoiding uncontrollable bias while ensuring unfiltered input from those who have the most at stake – the users.