A growth report prominently features "total users: 500,000," a genuinely large and impressive-sounding number that continues climbing every reporting period, regardless of whether the underlying business is thriving or quietly struggling. This is a defining feature of a vanity metric: a cumulative total can only increase or stay flat, never decrease, which means it structurally cannot reflect deterioration in the underlying business the way a rate-based or cohort-based metric naturally would.
Why cumulative totals are the most common vanity metric
Any cumulative count — total signups, total downloads, total pageviews, total accounts created — sums every unit ever added and never subtracts anything, meaning the number trends upward for virtually any product that has any ongoing marketing spend or user acquisition activity at all, independent of retention, engagement, revenue, or genuine product health. A company losing the large majority of its customers shortly after acquisition can still report a steadily climbing "total users" figure indefinitely, since the metric has no mechanism for reflecting the loss.
The practical test for whether a metric is actionable
A genuinely actionable metric is one where either direction of movement would meaningfully change a specific decision — a declining week-over-week retention rate should trigger real investigation and a different set of priorities than a stable or improving one, and the metric's actual movement in either direction carries real decision-relevant information. A metric that only ever moves in one direction, or that moves in a way disconnected from what the organization would actually do differently in response, fails this test regardless of how prominently it's reported or how impressive the number looks in isolation.
Why vanity metrics persist in reporting despite this
A metric that reliably goes up is simply more pleasant to report and more flattering to present than one that fluctuates or, worse, declines, which creates an understandable but distorting incentive to feature cumulative totals prominently in reporting even when they contribute little decision-relevant information — the metric doing real communicative work in a report isn't always the one occupying the most prominent position in it.
What replaces vanity metrics in a more useful reporting structure
Rate-based metrics — retention rate, conversion rate, activation rate — can genuinely move in either direction and directly reflect whether the underlying business is improving or deteriorating, in a way a cumulative total structurally cannot. Cohort-based analysis, tracking how a specific group of users acquired in a specific period behaves over time relative to other cohorts, reveals whether the business is actually getting better at acquiring and retaining valuable customers, information that's completely invisible in an aggregate cumulative total that blends cohorts of wildly different quality together into one ever-growing number.
What this means for how product and growth reporting should be structured
- Feature rate-based and cohort-based metrics prominently in regular reporting, rather than leading with cumulative totals
- Apply the actionability test directly — would movement in either direction on this metric change a real decision — to any metric being considered for a report's headline position
- Be specifically skeptical of reporting that leads with a cumulative total and treats it as evidence of overall health, since the metric structurally can't reflect deterioration
- Track cumulative totals as one input among several where genuinely relevant (overall scale, market presence), but not as the primary indicator of whether the business is actually improving
A metric that only ever goes up isn't lying, exactly — it's answering a question about scale, not about health, and the confusion between the two is where vanity metrics do their quiet damage in how organizations understand their own trajectory.