Confirmation Bias Lab

Does AI Recommend
What You Ask It To?

A HBR study tested 15,000+ scenarios and found that the order options are presented is the variable that most influences AI recommendations — not context, not data, not reasoning depth. Select a strategic tension below and compare how four different models respond to the same prompt.

Article — Confirmation Bias in AI Models
Business Context
Original order
Option A
Option B
Majority recommendation: — × Option A — × Option B
Order Effect

Model Responses

Llama 3.2 · 3B
Llama 3.1 · 8B
Mistral · 7B
Llama 3.1 · 8B · v2