Skip to main content

Topic

Market Research & Surveys

For market research agencies, independent researchers, ux researchers, and consumer researchers.

Acquiescence Bias and Satisficing: Why Long Surveys Quietly Stop Measuring What They Claim To

A respondent's tenth straight agree-scale question doesn't get the same careful consideration as the first — acquiescence and satisficing both quietly substitute effort-minimizing shortcuts for genuine judgment.

Card Sorting for Enterprise Navigation Reveals a Specific Problem: Internal Org Charts Leak Into Customer-Facing Structure

A navigation menu organized around "Reporting," "Admin," and "Integrations" often reflects which internal team owns which feature, not how a customer actually thinks about accomplishing their own goals within the product.

Card Sorting: Why Letting Users Organize Your Content Beats Guessing How They'll Look for It

The internal logic behind a product's navigation and the logic actual users bring to finding things within it are frequently different — card sorting exists specifically to surface that gap before launch.

Cluster Sampling: Why a Practical Sampling Shortcut Comes With a Real Statistical Price

Surveying every customer within a handful of selected regional offices is considerably cheaper than surveying an equal number of customers scattered randomly across every office nationwide — and the two approaches don't produce equally precise results.

Conjoint Analysis: Why Asking Customers to Rank Features Directly Gives You the Wrong Priorities

Asked directly, customers say every feature matters. Forced to choose between realistic product bundles, the same customers reveal a genuine, usable set of trade-off priorities they couldn't articulate any other way.

How to Price a Research Project When the Client Doesn't Know What They're Buying

Most research proposals get priced against a brief that's actually three different possible projects wearing one description. Here's how to price the one you're actually going to deliver.

Interviewer Effects: Why Who Asks the Question Changes the Answer, Even Reading From an Identical Script

The same script, read by two different interviewers, can produce meaningfully different response patterns on sensitive topics — a documented effect that has nothing to do with either interviewer doing anything wrong.

Panel Conditioning: Why Repeatedly Surveying the Same People Changes Who They Become as Respondents

A panel member who's answered the same brand-tracking survey a dozen times isn't a neutral, unchanged observer anymore — the repeated measurement has become part of what's being measured.

Projective Techniques: Why Asking Someone to Describe a Brand as a Person Sometimes Beats Asking Directly

Some brand and product perceptions live below the level of conscious, articulable belief — projective techniques work around this by asking an indirect question that doesn't require the respondent to already have a ready-made verbal answer.

Question Order Effects: Why Where a Question Sits in a Survey Changes How People Answer It

The identical question, asked first versus asked fifteenth, can produce meaningfully different answer distributions — order isn't a neutral container for content.

Quota Sampling vs. Random Sampling: The Trade-Off Most Market Research Reports Never Mention

A survey filled via quotas to match known population demographics can look statistically representative on paper while still carrying selection risks random sampling was specifically designed to avoid.

Recall Bias: Why Asking People to Remember Last Year Gets You This Year's Opinions in Disguise

Asking a customer to recall how satisfied they were six months ago produces an answer contaminated by everything that's happened to them since — recall isn't retrieval, it's reconstruction.

Running a Rigorous Study Solo: What You Can't Skip When There's No Team to Check Your Work

The errors a team catches by having multiple people touch a study don't disappear when you work alone — they just go uncaught unless you replace that check with something explicit.

Sample Size Doesn't Fix a Biased Sample — Why 2,000 From the Wrong People Beats 200 From the Right Ones

A research agency proud of a 2,000-respondent sample can still be delivering a worse answer than a smaller, more carefully recruited study, because sample size and sample bias are entirely separate problems.

Scope Creep Is a Research Design Problem, Not Just a Client Management Problem

Scope creep in independent research is usually discussed as a budgeting and boundaries problem. It's just as often a quiet, direct threat to whether the study can actually answer its original question.

Social Desirability Bias: Why Survey Respondents Answer Who They'd Like to Be, Not Who They Are

People systematically over-report virtuous behavior and under-report undesirable behavior on surveys, even when told their answers are anonymous — and the bias is predictable enough to design around.

Stated Preference vs Revealed Preference: Why Consumers Say One Thing and Buy Another

A consumer who says sustainability is their top purchase driver and then buys the cheaper, less sustainable option isn't lying in the survey — stated and revealed preference measure genuinely different things.

Survey Question Wording: The Bias Nobody Notices

Leading language, double-barreled questions, and unbalanced scales don't feel biased when you write them yourself. Here's how to catch them before the study goes live.

The Framing Effect: Why the Same Question Gets Different Answers Depending on How It's Worded

Two survey questions describing the exact same policy or product feature, one framed around gains and one around losses, can produce meaningfully different response patterns from the identical underlying facts.

The Telescoping Effect: Why People Remember Past Purchases and Events as More Recent Than They Actually Were

A customer asked how recently they made a purchase will often place it closer to the present than it actually happened — a systematic, well-documented memory distortion, not a random guess in either direction.

Unaided Recall and Aided Recognition Measure Two Genuinely Different Things About Brand Awareness

A brand can achieve strong aided recognition, being reliably recognized once named, while showing weak unaided recall, rarely coming to mind first without any prompting at all — two genuinely different competitive positions.

Usability Testing and Discovery Research Answer Different Questions — Conflating Them Wastes Both

A team that runs usability testing on a prototype and treats the results as validation of the underlying concept is answering a question nobody asked.

Verbatim Coding: Why Two Researchers Reading the Same Open-Ended Answers Can Reach Different Conclusions

The same set of open-ended customer comments, coded independently by two analysts without a shared framework, can produce meaningfully different theme summaries — a coding process problem, not a data problem.

Why a Focus Group Recruited From the Same Customer Segment Can Produce a False Sense of Consensus

A focus group where participants quickly, smoothly reach apparent agreement isn't necessarily revealing genuine, representative consensus — it may be revealing the same groupthink dynamics a too-homogeneous group is specifically prone to.

Why an Online Panel Survey Can Systematically Miss the People You Most Need to Hear From

The convenience of an always-available online survey panel comes from a specific selection process — people who chose to join a panel for rewards — that isn't the same thing as a random cross-section of the population.

Why Asking Customers to Describe a Brand as a Person Reveals More Than Direct Questions Sometimes Can

Asking a respondent to describe what kind of person a brand would be if it were human can surface genuine underlying associations that direct questions about brand attributes often fail to draw out as clearly.

Why Online Survey Research Now Has to Actively Screen for People Gaming the System

Straight-lining through grid questions, rushing past a survey's minimum realistic completion time, and failing embedded attention checks are all specific, detectable signs a respondent wasn't actually engaging with the questions.

Why People Systematically Over-Report Good Behavior and Under-Report Bad Behavior in Surveys

Self-reported survey data on socially sensitive behaviors systematically diverges from actual behavior in a predictable direction, toward whatever answer appears more socially desirable, regardless of the respondent's actual conduct.

Why Watching Shoppers Shop Can Change How They Actually Shop

A shopper who notices they're being observed, even subtly, may browse more carefully, linger longer, or make different purchase decisions than they would during an entirely unobserved, ordinary shopping trip.