Direct Answer
Reference inflation is the tendency for employment references and letters of recommendation to be overwhelmingly positive — so positive that they fail to distinguish between candidates. When virtually every reference describes a candidate as “excellent” or “outstanding,” the information becomes meaningless for decision-making. This is not a minor issue. It is one of the most well-documented problems in personnel selection research.
Why It Matters
Think of reference inflation like grade inflation in universities. When nearly every student receives an A, grades stop telling you who actually excelled. The same thing happens with references. If every candidate’s references describe them in glowing terms, hiring managers cannot use that information to make meaningful comparisons.
This is not hypothetical. The inflation problem is so severe that it has contributed to a widespread belief that reference checks are a waste of time — a belief that, while understandable, conflates the failure of unstructured methods with the inherent value of reference information.
The Science Behind It
The data on reference inflation is striking. Aamodt and Williams (2005, as cited in Nicklin & Roch, 2009) analyzed 6,854 ratings from letters of recommendation and found that only 0.23% — 16 out of nearly 7,000 ratings — fell below average. Miller and Van Rybroek (1988, as cited in Nicklin & Roch, 2009) reported being “struck” by the disproportionate number of candidates described as being in the top 1–5% of their distribution.
In a survey of 575 professionals in personnel-related fields, Nicklin and Roch (2009) found that experts reached consensus on one thing above all: letter inflation is pervasive and may never be fully eliminated — at least in unstructured formats. Academic professionals reported encountering inflation even more frequently than applied practitioners.
Perhaps most troubling, Nicklin and Roch (2008) found that applicants with inflated letters were more likely to be recommended for hiring and predicted to become more successful — even when readers recognized that the letter contained exaggerations. Inflation distorts decisions even when people are aware of it.
Structure counteracts inflation. Fisher et al. (2022) demonstrated that imposing even a loose structure on employment references — such as requesting three specific strengths and three areas for improvement — produced meaningful variation in responses and effectively eliminated systematic gender bias in a sample of nearly one million applicants and over four million reference providers. Structured, quantitative formats force raters to make finer distinctions that open-ended formats allow them to avoid.
Common Misconceptions
Some people assume that inflation means references are being deliberately dishonest. In most cases, it reflects social pressure rather than deception. Reference providers want to help the candidate, fear legal consequences of negative statements, and default to positive language when given no structure to guide their response. The problem is not bad intentions — it is a predictable consequence of asking open-ended questions in a high-stakes social context.
How This Connects to Better Hiring
Reference inflation is not an argument against reference checking. It is an argument against unstructured reference checking. When references are collected using standardized, behavior-focused questions with consistent rating scales, the ceiling effect that inflation creates is substantially reduced. The solution is not to abandon reference information — it is to collect it in a way that produces genuine variation and meaningful data.