Polar Bear / Blog / High-Quality Review Process

Ratings, no ratings, or both? Choosing a review model

Published

The choice isn't really "ratings vs. no ratings" — it's what decision the score has to support. If a review must calibrate people across leads, defend a promotion, and inform up-or-out and staffing calls, you need a defensible rating. If it only drives development, continuous feedback without a number can be enough. For most project-based firms the honest answer is "both": a light, calibrated rating for the decisions that need differentiation, plus continuous feedback for growth.

And the lesson many big-name firms learned the hard way — dropping ratings doesn't drop the underlying judgment; it just moves it somewhere less visible and less fair. When CEB studied companies that removed ratings, employee performance fell about 10% on average and the quality of manager conversations dropped 14% (CEB, 2016). Meanwhile almost all employers still use a rating in some form (Mercer, 2025). So start from the decision, not the format.

Questions about your review model? Book a free call — we'll help you match the model to the decisions your reviews actually have to make.
Book a call →

Ratings, no ratings, or both — what does each model actually mean?

Three models, defined plainly. A ratings model attaches a score to the review — a number or a label ("meets / exceeds", a 1–5, a grade) that summarises performance against a bar and lets you compare people. A no-ratings model drops the score and keeps the substance: narrative feedback, frequent check-ins and documented conversations, with no summary number. A hybrid keeps a calibrated rating for the decisions that need it and runs continuous feedback alongside it for development.

The mistake is to argue about the format in the abstract. A rating is not good or bad in itself; it is an output that some decisions require and others don't. Deloitte made exactly this move when it rebuilt its system: it separated the pay decision from the day-to-day performance conversation, and produced a quick per-project "snapshot" plus weekly check-ins (Buckingham & Goodall, Harvard Business Review, 2015). Same firm, both mechanisms — one to differentiate, one to develop. That is the real design question underneath "ratings or not".

Make it concrete with one person. Picture a senior designer staffed on three client projects across a year. Under a ratings model, each lead scores her against a shared bar and those reads are calibrated into a single number that feeds her promotion case. Under a no-ratings model, each lead instead leaves documented feedback and running check-in notes, and no summary grade is ever produced. Under a hybrid, she gets both: one calibrated rating for the promotion decision, plus a stream of feedback she can act on between projects. Same designer, same year — three very different things the firm can do with what her leads saw.

Start from the decision, not the format ASK FIRST What decision must the review support? RATINGS Must differentiate: promote, pay, up-or-out, calibrate across leads. → a calibrated score NO RATINGS Only develops people: small, high-trust team, strong managers, no hard differentiation. → narrative + check-ins HYBRID Must do both: differentiate AND grow people every cycle. → calibrated rating + continuous feedback
Type-B schematic. The model follows the decision: differentiation needs a rating; pure development may not; most project firms need both, kept separate.

Why did so many firms drop ratings — and what happened next?

Because the annual rating had become expensive theatre. Deloitte found it was spending close to 2 million hours a year on performance management, and 58% of its executives said the approach drove neither engagement nor high performance (Buckingham & Goodall, HBR, 2015). Adobe abolished the annual review and stack-ranking in 2012, replacing them with lightweight "Check-ins" and reclaiming an estimated 80,000 manager-hours a year (Adobe, via Stanford GSB, 2016). Microsoft ended its forced "stack ranking" in 2013 because grading people on a curve pitted colleagues against each other (Microsoft, via CNN/SHRM, 2013). General Electric went further still: in 2015 it began retiring a decades-old five-point rating scale — from "role model" down to "unsatisfactory" — in favour of an app-based continuous-feedback tool, PD@GE (GE, via Fortune, 2015). The wave looked like the end of ratings.

Then the evidence came back the other way. CEB studied organisations that had removed ratings and found the opposite of what was promised: employee performance dropped about 10% on average, the quality of employees' performance conversations with managers fell 14%, and the share of people who believed the firm connected performance to pay fell 8% — with high performers hit hardest (CEB, 2016). The judgment didn't disappear; managers still decided pay and promotions, they just did it with less structure and less visibility. So most firms kept a rating: as of 2025, almost all employers still use one, and only 8% force a distribution (Mercer, 2025). The lesson isn't "ratings won" — it's that removing the number doesn't remove the decision.

What fell when companies removed ratings Change vs. organisations that kept ratings (lower is worse) Conversation quality −14% Employee performance −10% Believe pay ~ performance −8%
Removing ratings didn't remove the judgment — it removed the structure around it. Source: CEB (now Gartner), "Performance Reviews: Don't Remove the Ratings", 2016.

What do ratings do well, and where do they fail?

Ratings do one thing no narrative does: they let you compare and calibrate. When you have to decide who gets promoted, who's ready for partner, who to keep on the bench and how to split a raise pool, a shared score on a shared bar makes the decision defensible — you can show the person, and a tribunal, how the call was made. A number also forces a manager to commit to a judgment rather than hide behind warm, non-committal prose.

Where ratings fail is precision. A rating carries a lot of the rater and not much of the performance: in a study of 4,492 managers, about 62% of the variance in ratings was idiosyncratic to the individual rater, while only 21% reflected actual performance (Scullen, Mount & Goff, Journal of Applied Psychology, 2000). A single reviewer is noisy — the mean interrater reliability of one supervisor's rating of overall performance is about .52 (Viswesvaran, Ones & Schmidt, Journal of Applied Psychology, 1996). Add recency and halo bias and rating anxiety, and a lone number can be both falsely precise and quietly unfair. The fix is not to abolish the rating; it is to calibrate it across raters so the score reflects the work, not who did the reviewing.

When does a no-ratings model work — and when does it break?

A no-ratings model works when the review's only job is development — and three conditions hold. First, the team is small and high-trust, so feedback flows without a score forcing it. Second, the managers are strong: able to have direct, specific conversations and make pay calls fairly without a number to hide behind. Third, there is no hard differentiation to defend — no up-or-out, no partner gate, no tight raise pool that has to be split and justified. Strip the rating in that setting and you lose little; you keep the substance and drop the theatre. Gap Inc. is the textbook version at scale: it scrapped annual reviews and ratings for "Grow. Perform. Succeed." — frequent coaching conversations and short goal cycles whose whole job is development, not differentiation (Gap Inc., via e-reward case study). A ten-person design studio where the founder already knows everyone's work is the small-team version of the same bet.

It breaks the moment a real differentiation decision lands. Without a shared score, managers struggle to explain how someone performed or why a pay decision went the way it did — which is exactly why conversation quality and the perceived pay-performance link fell when ratings were removed (CEB, 2016). And the judgment doesn't go away: it goes underground, into a manager's private ranking that no one can see, calibrate or challenge. That is less fair than an explicit rating, not more. If your firm has to promote, staff and defend up-or-out, pure no-ratings quietly moves the hardest calls somewhere with no audit trail.

Why does "both" usually fit agencies and consulting boutiques?

Because a project-based firm runs both jobs at once, and a single model can't do both well. Your people are staffed per engagement and rated by different leads, and those reads have to roll up into promotion, raises, bench decisions and up-or-out on a partner track. That is a differentiation problem — it needs a calibrated rating, or one lead's generosity and another's severity decide someone's career. But the same people also need to grow between cycles, and a once-a-year grade is useless for that — growth needs continuous feedback close to the work.

So the honest answer for most boutiques and agencies is a hybrid: a light, calibrated rating on a shared bar for the decisions that require differentiation, plus ongoing feedback and check-ins that carry development. Keep the two separate — the rating is the calibrated judgment of the past; the feedback is the forward-looking growth conversation — so the number doesn't poison candour and the coaching doesn't get quietly renegotiated into a grade. Deloitte's split of the pay decision from the weekly conversation is the same idea (Buckingham & Goodall, HBR, 2015), and CIPD frames performance management as a continuous cycle you fit to your own context rather than a single annual event (CIPD, Performance Management). Going fully no-ratings removes signal your partner track still needs; making the rating the whole story punishes the candour your feedback culture depends on. Both, kept apart, is usually the fit.

Concretely, that can be modest. A 25-person data-consulting boutique might keep a simple 1–4 rating, calibrated across the leads who staffed each consultant, purely to make partner-track and raise-pool calls defensible — and run fortnightly check-ins that never touch that number, so coaching stays honest. A creative agency might do the same with a "below / at / above bar" label reconciled in a 30-minute cross-lead calibration, plus a running feedback doc per person. The rating stays light; the development runs continuously; neither is allowed to quietly become the other.

How do you choose a model for your firm?

Work down from the decisions, not up from the format.

  1. List the decisions the review must support. Promotion, partner/up-or-out, raise-pool splits, staffing and bench calls, development. Write them down — this list, not fashion, picks your model.
  2. Ask if any decision needs differentiation. If you must rank, calibrate across leads, or defend a promotion or exit, you need a rating. If the only output is growth, you don't.
  3. Check your calibration honestly. A rating is only as fair as the calibration behind it. One lead scoring alone is noise (Scullen, Mount & Goff, 2000); if you can't run a cross-lead calibration, fix that before you trust any score.
  4. Judge your managers and your trust level. No-ratings leans hard on strong managers and high trust. If either is thin, a shared bar protects your people from inconsistent judgment.
  5. If you have both jobs, run a hybrid — and keep the halves apart. A calibrated rating for the decisions that need it; continuous feedback for development; never let one silently become the other.
  6. Name where the judgment lives. Whatever you choose, make the differentiation decision explicit and calibrated. If your model pushes it into a manager's head, you haven't removed bias — you've hidden it.

A quick decision self-check

Score your current model: one point per "yes". Six or more and your model fits your decisions; four or fewer and you're likely arguing format instead of purpose.

  • You've written down the actual decisions your reviews must support.
  • You know whether any of those decisions require differentiation (promote, pay, up-or-out).
  • If you rate, the score is calibrated across the leads who staffed the person — not one lead alone.
  • If you don't rate, no hard differentiation decision secretly depends on a hidden ranking.
  • Development feedback runs continuously, not once a year.
  • Your rating (if any) is kept separate from the forward-looking growth conversation.
  • People can see the bar they're measured against before the cycle, not after.
  • The person making a promotion or pay call can explain it against shared evidence.

Scored four or fewer? Book a call and we'll help you pick a model that matches the decisions your firm actually makes.

FAQ

Is it better to have performance ratings or not?

Neither is better in the abstract — it depends on what the review has to decide. If it must differentiate people for promotion, pay or up-or-out, a calibrated rating makes the decision fair and defensible. If it only drives development, continuous feedback without a number can be enough. When companies removed ratings, performance and conversation quality actually fell (CEB, 2016), because the judgment didn't disappear — it just went unstructured.

Why did companies like Adobe and Microsoft drop ratings?

The annual rating had become slow and expensive — Deloitte alone spent close to 2 million hours a year on it (Buckingham & Goodall, HBR, 2015) — and forced-curve ranking damaged collaboration, which is why Microsoft ended stack ranking in 2013, GE retired its five-point scale for the PD@GE app in 2015, and Adobe replaced annual reviews with lightweight check-ins in 2012. Others, like Gap Inc., dropped ratings entirely in favour of frequent coaching conversations (Gap Inc., via e-reward). Most firms, though, kept a rating in some form; as of 2025 almost all employers still use one (Mercer, 2025).

Doesn't a rating just add bias?

A single rating is noisy — about 62% of rating variance is down to the individual rater, not the performance (Scullen, Mount & Goff, 2000), and one supervisor's reliability is only around .52 (Viswesvaran, Ones & Schmidt, 1996). But dropping the rating doesn't remove that judgment; it hides it in a manager's head where no one can calibrate it. Calibrating the score across multiple leads is what reduces the bias, whether or not you show a number.

What does a hybrid model look like for a consulting boutique?

A light, calibrated rating on a shared bar — built from per-engagement inputs and reconciled across the leads who staffed the person — that feeds promotion, raises, staffing and the partner track. Alongside it, continuous feedback and check-ins carry development between cycles. The two are kept separate so the rating stays honest and the growth conversation stays open.

How do I choose between the models?

Start from the decisions your reviews must support, not from what other firms do. If any decision needs differentiation, you need a defensible, calibrated rating; if the only output is growth, you may not. If you have both jobs — which most project-based firms do — run a hybrid and keep the rating separate from the development conversation (CIPD, Performance Management).

About us

Both ex-McKinsey, we bring the best practices of people growth to the agency world, building simple, lovable people systems without the corporate HR heritage.

Pauline Bertry

Pauline Bertry

Product Growth · CX Design

10+ years leading product & design teams. Built from scratch and led Design Hubs at McKinsey Moscow and Budapest. Created career frameworks and growth systems tested with 100+ person cross-functional product teams.

Meet Pauline →
Alexey Lobachev

Alexey Lobachev

People Strategy · Engagement

9 years running communication, people, experience and engagement programs at McKinsey taught him the hardest skill in operations: knowing what to delegate, what to automate, and what to leave alone. As a co-founder of Polar Bear he applies that instinct to AI agents, building them to augment the internal processes and tools his team already runs on.

Meet AlexeyComing soon

Dealing with a people challenge and not sure where to start?

Let's have a conversation

Sources

  1. Buckingham, M. & Goodall, A. (2015). Reinventing Performance Management. Harvard Business Review, April 2015. Deloitte found it was spending ~2 million hours a year on performance management; 58% of executives said the approach drove neither engagement nor high performance; the redesign separated pay from the day-to-day conversation. hbr.org
  2. Adobe "Check-in" (2012), via Stanford Graduate School of Business case study (2016). Adobe abolished the annual review and stack-ranking in 2012, moving to frequent lightweight check-ins; it estimated the old annual review consumed ~80,000 hours of managers' time a year. gsb.stanford.edu
  3. Microsoft (November 2013), via CNN Money / SHRM. Microsoft ended its "stack ranking" system, no longer forcing managers to grade employees against one another on a curve. money.cnn.com
  4. CEB (now Gartner) (2016). Performance Reviews: Don't Remove the Ratings (press release, 7 Nov 2016). Removing ratings was associated with employee performance dropping ~10% on average; performance-conversation quality scored 14% lower; belief that the firm links performance to pay fell 8%; high performers hit hardest. prnewswire.com
  5. Scullen, S. E., Mount, M. K. & Goff, M. (2000). Understanding the latent structure of job performance ratings. Journal of Applied Psychology, 85(6), 956–970. Across 4,492 managers, ~62% of rating variance was idiosyncratic to the rater; ~21% reflected actual performance. Reference
  6. Viswesvaran, C., Ones, D. S. & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81(5), 557–574. Mean interrater reliability of a single supervisor's rating of overall job performance ≈ .52 (K=40, N=14,650). pmc.ncbi.nlm.nih.gov
  7. Mercer (2025). HR Performance Management (QuickPulse survey). Almost all employers still use performance ratings; only 8% use a forced distribution. imercer.com
  8. CIPD. Performance Management (factsheet). Performance management should be a continuous cycle, not an isolated event, with practices fitted to the organisation's own context. cipd.org
  9. GE, via Fortune (13 Aug 2015), "Here's why GE is replacing performance reviews with an app." In 2015 GE moved away from a decades-old annual five-point rating scale (from "role model" to "unsatisfactory") to an app-based continuous-feedback tool, PD@GE. fortune.com
  10. Gap Inc., via e-reward case study, "Gap Inc. encourages employees to Grow, Perform and Succeed – without ratings." Gap replaced annual reviews and ratings with "Grow. Perform. Succeed." (GPS): frequent coaching conversations and short goal cycles focused on development. e-reward.co.uk