DEV Community

Serguey Asael Shinder
Serguey Asael Shinder

Posted on

You Rated the Engineer Who Presents Well as Better at Everything Else Too

Review season.

Six engineers.

Five headings each.

Code quality.

Reliability.

Collaboration.

Technical judgement.

Communication.

One of them
gave the best demo of the year.

Clear,
calm,
funny.

You wrote her down
as excellent at communication.

Fair.

Then you noticed
she was also excellent
at everything else.

Her code was clean.

Her judgement was sound.

You had not read
much of her code this year.

You had seen her
for twenty minutes,
very well.

In 1920
the psychologist Edward Thorndike
looked at how army officers
rated their soldiers.

Physique,
intelligence,
leadership,
character.

Separate qualities,
rated separately.

The ratings moved together
far more than the qualities could.

A soldier seen as good
in one respect
was seen as good in all of them.

He called it the halo effect.

It has been found
in teachers marking essays,
in interviews,
in reviews like yours.

It runs the other way too.

The quiet engineer
who stumbled through one demo
starts to look
a little weaker
at everything.

Here is why it happens.

Judging five things separately
is hard work.

Forming one impression
is easy.

So the mind forms the impression
and then answers each question
by asking it.

And it never feels like that
from the inside.

It feels like five
independent observations
that happen to agree.

You cannot switch it off.

You can design around it.

Rate each heading
across all six people
before moving to the next,
instead of one person at a time.

Write down the evidence
before the score,
and if a heading has no evidence,
say so,
instead of letting the impression fill it.

Ask someone
who saw a different side of the work.

Count the incidents she caused
and the reviews she gave,
not just the presentations.

Then check your sheet.

If someone is top
on every line,
or bottom on every line,
look again.

Real people
are uneven.

When your ratings are not,
you are rating one thing
five times.

– Serguey Asael Shinder

Top comments (0)