Large language models increasingly handle both sides of the hiring equation. Job seekers use them to craft resumes. Recruiters deploy them to sift through stacks of applications. This setup creates a hidden distortion: LLMs favor text that mirrors their own style. A new study quantifies the problem. It shows these models boost chances for AI-polished resumes by 23% to 60%, even when human versions match in quality. arXiv preprint 2509.00462 by Jiannan Xu, Gujie Li, and Jane Yi Jiang lays out the evidence in stark terms.
The researchers ran a controlled experiment with 2,245 pre-ChatGPT human-written resumes pulled from LiveCareer.com. They spanned 24 occupations, from sales to agriculture. For each, LLMs generated executive summaries—30 to 80 words capturing skills and experience. These got pitted against originals in pairwise comparisons. Nine models judged: GPT-4o, Claude-3.5-Sonnet, LLaMA-3.3-70B, DeepSeek-V3, and others, both commercial and open-source.
Results hit hard. LLMs picked their own summaries over human ones 67% to 82% of the time. GPT-4o showed 82% bias. LLaMA-3.3-70B clocked 79%. Even after matching for semantics via BERTScore and ROUGE-L, or style via LIWC features, the preference held. “This bias against human-written resumes is particularly substantial,” the authors write.
LLM-vs-LLM matches proved messier. DeepSeek-V3 favored itself 69% over LLaMA but lost 39% to GPT-4o. Patterns persisted under robustness checks, like revising human summaries instead of full rewrites.
To gauge real impact, the team simulated hiring pipelines. Candidates submitting evaluator-matched AI resumes saw shortlisting rates jump 23% in agriculture to 60% in sales. Accounting and business roles fared worst for humans. False negatives loomed large—qualified applicants dumped for stylistic mismatch.
Why? Self-recognition. LLMs detect their ‘dialect’—token patterns, phrasing quirks. The paper calls it an ‘endogenous distortion’ in AI-mediated screening, beyond noise or demographics.
Mitigations Cut Bias in Half
Fixes exist. Prompt tweaks telling models to ignore origin slashed bias 17% to 63%. GPT-4o’s 82% dropped to 30%. Majority voting with low-bias models helped too. Simple. Effective.
But the study goes deeper. It ties into operations management views of hiring as capacity-constrained matching. AI amps asymmetric errors: missing talent hurts more than false positives. Prior work on generative AI showed style boosts signals but amplifies race/gender gaps. Here, model lock-in emerges—use the recruiter’s LLM, win big.
Recent buzz amplifies the point. A LinkedIn post by Angela Champ highlighted the abstract, sparking shares. HireVue’s 2026 Global AI in Hiring Report, posted April 30, notes 71% of candidates use AI for resumes, while 77% of managers do—but only 44% trust the tools. Reddit threads on r/jobhunting echo suspicions: AI screeners pick ‘the candidate that sounds most like themselves.’ One user linked the paper directly: “Recent research shows AI resumes screeners prefer…” Reddit r/jobhunting.
And it’s spreading. Instagram reels from @thewizeai, citing the study, warn: “AI hiring tools don’t pick the best candidate. They pick the candidate that sounds most like themselves.” A LinkedIn analysis by Hari Prasad Rajagopalan called it a new standard: “send an AI agent that demonstrates your skills.” LinkedIn.
Policy lags. Fairness audits chase demographic skews. This demands more: track AI-AI clashes. Transparency rules could mandate model disclosure. Or hybrid screens blending AI and humans.
Hiring pros face a choice. Stick with pure AI, risk tilting the field toward same-model users. Add safeguards, preserve merit. The bias isn’t malice. It’s mechanics—LLMs mirroring themselves. Ignore it, and human talent pays the price.
So what’s next? Multilingual tests. Field experiments with real applicants. Broader domains: content moderation, where creators and censors both lean on LLMs. The paper urges expanded fairness frames. AI interacts with AI now. Time to audit those handshakes.
WebProNews is an iEntry Publication