Sign up for First Take, our daily insider email
Complete Awards Season Coverage

Revealed: How Oscar Nominee Ballots Are Counted

Revealed: How Oscar Nominee Ballots Are Counted

EMAIL
PRINT

Academy members receive their Oscar ballots this week, and will begin returning them to PricewaterhouseCoopers almost immediately. 

As for what happens next, even most voters have little idea.

The Academy’s executive director, Bruce Davis, has spoken to groups about the process, sent letters to Academy branches that have asked for explanations, and tried to make sure that members understand why the system will let them vote for their favorites without second-guessing or playing games.

But he’s not convinced that the message ever really sinks in. “I don’t think a very high percentage of members could describe exactly how it works,” he once told me. “When I hear them talking about it, I can tell they don’t understand.”

So how does it work?

Take a deep breath ...

To begin with, it doesn’t involve computers. This is a very low-tech process, one that involves stacking ballots on a table -- and not leaving a paper trail. Called the “preferential system,” it's an intricate and little-used process also known as instant runoff voting.

It can be used to come up with a slate of candidates. It also can be used to avoid runoff elections by looking at a voter’s second and third choices -- but it only does that as needed.

And, theoretically, it avoids the problems that can arise in a typical weighted system, in which your first choice gets 10 points, your second choice nine, etc.

Ideally, the system means voters won’t have to play games with their ballots; they can vote for the films they truly believe are best, and the system will allocate their vote where it will do the most good. Your vote will go to your last-place choice only if your other choices don’t need it.

Before we get into the process, a couple of key points:

First, you’re listing five or 10 films on your ballot, but you’re only actually voting for one. Your ballot gives you a single vote, which goes to a single film. (Ballot photo: Greg Harbaugh/AMPAS).

Second, if a movie's not ranked number one on somebody’s ballot, it's out. This serves to narrow the field considerably.

One result of this that the number of films contending for the 10 Best Picture nominations will actually be no larger than the number that would have been contending for five.

Example: Movie City News is now compiling all the critics’ top 10 lists for the year. As of this weekend, they had 54 lists, which mentioned a total of 104 different films.

But only 21 of those films were ranked number one on the ballots – so if those lists were tabulated using the preferential system, those 21 films would be in the running and the other 83 would be immediately eliminated.

Let's begin ...

Conjuring up the magic number ...
If you’re a PricewaterhouseCoopers accountant on the Oscar team, you’ll start by taking all the ballots in a category, counting them and determining how many votes it’ll take to guarantee a spot in the top 10, or the top five.

The math is simple: You take the number of nominations up for grabs, add one, and use the resulting number to divide the number of votes. Then you add one, or any fraction of one.

For instance, if you have 5,500 Best Picture ballots and you’re looking for 10 nominees, you divide 5,500 by 11, giving you a magic number of 500. Now, it’s theoretically possible that 11 different films could each receive 500 votes – but if you add one (or any fraction, if that magic number isn’t a whole number), you’ll get the number that will automatically put you in the top 10, and thus guarantee you a nomination.

So in our hypothetical example, the magic number for a Best Picture nomination is 501.

... then sharing the wealth
With that number in hand, you sort all the ballots into stacks, according to each voter’s number-one choice. If any film has reached the magic number, it’s a nominee, and you take its stack of ballots off the table.

That’s the end of round one. To start round two, you look at the stacks that remain on the table, and eliminate the film with the smallest number of votes. You pick up that pile of ballots, and redistribute them according to the film ranked second on each of those ballots.

If a particular ballot’s number-two choice has already been eliminated, or has already secured a nomination, then you go to the number-three choice, or you move as far down the ballot as is necessary to find a film that’s still in contention.

Once the redistribution has taken place, you recount all the stacks. If any film has now passed the threshold, it’s added to the list of nominees, and you take its stack off the table. Then, to start round three, you locate the smallest remaining stack and redistribute it in the same way.

The process continues, with the smallest stack redistributed, until the field has been narrowed down to 10, or five, or whatever number you want.

Those are the basics. But (sorry about this), there are complications.

Reshuffling the decks
First of all, explanations of the process rarely get into this, but the magic number changes slightly with each new round of voting.

For each subsequent round, you have to recalculate how many ballots are still in play and how many nominations remain up for grabs, and do the math all over again.

Going back to our hypothetical 5,500-vote Best Picture vote, let’s say that we’ve assembled all the ballots into stacks, and the results look like this:

“Up in the Air” – 575 votes
“Avatar” -- 550
“The Hurt Locker” -- 475
“Precious” -- 475
“Up” -- 450
“Inglourious Basterds” -- 425
“Invictus” -- 375
“Nine” -- 350
“An Education” -- 325
“A Serious Man” -- 325
“The Last Station” -- 300
“The Messenger” -- 250
“District 9” -- 200
“Star Trek” -- 175
“This Is It” -- 150
“The Lovely Bones” -- 100

Since the magic number is 501, that means that “Up in the Air” and “Avatar” are first-round nominees.

 
1 | 2
Next

Comments

@pointofit

This is how I understood the point of the surplus rule:

Imagine if there was some other movie released last year that a grand cinematic achievement, an instantly declared masterpiece and was just such a hands down favorite that something like 75% of voters put it as first. Their 2nd place votes were evenly distributed amongst Avatar, Up in the Air and Hurt Locker.

13% of voters put Nine as their favorite film, and the rest of the voters were evenly split more-or-less amongst the rest of the films.

If there were no surplus rule, that first group of ballots would be taken off the table and Nine would be the next film to make the nomination list, even though more people liked Avatar, Up in the Air and Hurt Locker.

Also, the surplus rule prevents people from saying, "well, my favorite was Up in the Air, but everyone is going to vote for that, so I'll put Avatar as first to make sure that gets nominated" and if enough people think that way, Up in the Air may not even be nominated.

Then again, if voters don't know the counting system, then I guess that last example doesn't matter.

As for your example: Under the five film system, the magic number starting in round one would have been 917, and even if the surplus rule was invoked, it would have taken more than just two rounds to choose the other 4 nominees. In the 10 film system, yes, 3 of those films would automatically make the cut, but there are still 6 more slots to fill.

Screw that, Ernie. Computers can't be trusted with something so important and delicate. Only humans should take care of this.

Steve,

Do we know what the purpose of the surplus rule is, how it's supposed to help the process at all?

It just seems random that some people would get to spread their vote in this way. Let's take your example, but say there's no Avatar and Up in the Air is over by double, freeing up 501 fractional votes, and the number 2's end up distributed as follows:

"Up in the Air" -- 501
“The Hurt Locker” -- 475 + 100
“Precious” -- 475 + 100
“Up” -- 450 + 100
“Inglourious Basterds” -- 425 + 100
Other films - 101

So now, the above four films are put over the magic number, locking FIVE films into Best Picture. I mean, under the 5 film system, it's all over and only half of the Academy got a vote! In effect, many of those people got to vote twice - even if fractional, those 1,001 Air-lovers get to contribute to two of their favorite films, whereas half the voters contribute to none.

And I actually don't think this is fuzzy/out there math - in years with one major front runner, this seems totally possible.

I'm just really curious how (or if) this somehow makes the process more fair in a way I don't understand.

I just hope that they see more the meaning of the movies. And example. Me, and Orson Welles. A Single Man. The Imaginarium of Doctor Parnassus. And others more artist than the ones that has so much violence.

Thanks so much for finally finding out about the wrinkles - because the abbreviated explanations from the past clearly do not work.

There reamin wrinkles to explain though:

In your simulation, where 500 votes are required, it is also possible that 55 films could receive 100 votes each and there are no first round winners. That is clearly unlikely but it seems VERY likely that no film could come out of the first round, and so I assume that the lowest #1 vote getter might get reassigned right out of the gate.

Of course, it is also possible that many of those initially reassigned votes might have NONE of the #1s on the rest of its list - just check some of the critics who disdain all mainstream films. I assume that the critical number is lowered as we go.

Frankly, I think that the wrinkles are constantly in play.

sigh. But THIS is why they will never release this round of results (or probably any). It would take three pages of explanations.

My-handbag.com is dedicated to bring buyers the top grade replicas.They are replica Balenciaga handbags,replica louis vuitton handbags,replica chanel handbags and replica handbags. We know that the quality of the product directly results in the impression given to people.
replica Balenciaga handbags
replica handbags
replica bags
replica Louis Vuitton handbags
replica Chanel handbags
replica Gucci handbags
replica Fendi handbags
replica Miumiu handbags
replica Hermes handbags
replica Coach handbags
Replicasincn.com is dedicated to bring buyers the top grade replicas .They receive wholesale replica handbags, wholesales replica belts, wholesales replica Chanel handbags, wholesale replica Louis Vuitton handbags, wholesales replica Gucci handbags, wholesales replica Balenciaga handbags and wholesales replica bags. We know that the quality of the product directly results in the impression given to people.
wholesale replica handbags
wholesale replica bags
wholesale fake handbags
wholesale fake bags
wholesale cheap handbags
wholesale designer handbags
wholesale replica belts
wholesale replica wallets
wholesale replica Louis Vuitton handbags
wholesale replica Balenciaga handbags
wholesale replica Chanel handbags
wholesale replica Gucci handbags
wholesale replica Fendi handbags
wholesale replica Miumiu handbags
wholesale replica Hermes handbags
wholesale replica Coach handbags

Really a educative and informative post, the post is good in all regards,I am glad to read this post.

http://ezinearticles.com/?Lean-Muscle-X-Review&id=3221720

@Ernie07
And blow all those billable hours. Are you nuts?

Problem with Instant Runoff Voting is sometimes if you get too much support, you can actually loose rather than win. It has happened in political races. Here's an easy description on how:

http://www.youtube.com/watch?v=XEkrFkqIHHI

Word on the street is Weinstein already has election consultants and mathematicians ready to review the system to see if he got screwed.

That is if the Academy will release the votes for independent analysis (which they should with such a complex system)

The algorithms used here are exactly what computers do quite well without requiring coffee breaks or causing eye strain. When will STONE age processing be replaced with software capable of providing reliable and consistent answers?

Comments

@pointofit

This is how I understood the point of the surplus rule:

Imagine if there was some other movie released last year that a grand cinematic achievement, an instantly declared masterpiece and was just such a hands down favorite that something like 75% of voters put it as first. Their 2nd place votes were evenly distributed amongst Avatar, Up in the Air and Hurt Locker.

13% of voters put Nine as their favorite film, and the rest of the voters were evenly split more-or-less amongst the rest of the films.

If there were no surplus rule, that first group of ballots would be taken off the table and Nine would be the next film to make the nomination list, even though more people liked Avatar, Up in the Air and Hurt Locker.

Also, the surplus rule prevents people from saying, "well, my favorite was Up in the Air, but everyone is going to vote for that, so I'll put Avatar as first to make sure that gets nominated" and if enough people think that way, Up in the Air may not even be nominated.

Then again, if voters don't know the counting system, then I guess that last example doesn't matter.

As for your example: Under the five film system, the magic number starting in round one would have been 917, and even if the surplus rule was invoked, it would have taken more than just two rounds to choose the other 4 nominees. In the 10 film system, yes, 3 of those films would automatically make the cut, but there are still 6 more slots to fill.

Screw that, Ernie. Computers can't be trusted with something so important and delicate. Only humans should take care of this.

Steve,

Do we know what the purpose of the surplus rule is, how it's supposed to help the process at all?

It just seems random that some people would get to spread their vote in this way. Let's take your example, but say there's no Avatar and Up in the Air is over by double, freeing up 501 fractional votes, and the number 2's end up distributed as follows:

"Up in the Air" -- 501
“The Hurt Locker” -- 475 + 100
“Precious” -- 475 + 100
“Up” -- 450 + 100
“Inglourious Basterds” -- 425 + 100
Other films - 101

So now, the above four films are put over the magic number, locking FIVE films into Best Picture. I mean, under the 5 film system, it's all over and only half of the Academy got a vote! In effect, many of those people got to vote twice - even if fractional, those 1,001 Air-lovers get to contribute to two of their favorite films, whereas half the voters contribute to none.

And I actually don't think this is fuzzy/out there math - in years with one major front runner, this seems totally possible.

I'm just really curious how (or if) this somehow makes the process more fair in a way I don't understand.

I just hope that they see more the meaning of the movies. And example. Me, and Orson Welles. A Single Man. The Imaginarium of Doctor Parnassus. And others more artist than the ones that has so much violence.

Thanks so much for finally finding out about the wrinkles - because the abbreviated explanations from the past clearly do not work.

There reamin wrinkles to explain though:

In your simulation, where 500 votes are required, it is also possible that 55 films could receive 100 votes each and there are no first round winners. That is clearly unlikely but it seems VERY likely that no film could come out of the first round, and so I assume that the lowest #1 vote getter might get reassigned right out of the gate.

Of course, it is also possible that many of those initially reassigned votes might have NONE of the #1s on the rest of its list - just check some of the critics who disdain all mainstream films. I assume that the critical number is lowered as we go.

Frankly, I think that the wrinkles are constantly in play.

sigh. But THIS is why they will never release this round of results (or probably any). It would take three pages of explanations.

My-handbag.com is dedicated to bring buyers the top grade replicas.They are replica Balenciaga handbags,replica louis vuitton handbags,replica chanel handbags and replica handbags. We know that the quality of the product directly results in the impression given to people.
replica Balenciaga handbags
replica handbags
replica bags
replica Louis Vuitton handbags
replica Chanel handbags
replica Gucci handbags
replica Fendi handbags
replica Miumiu handbags
replica Hermes handbags
replica Coach handbags
Replicasincn.com is dedicated to bring buyers the top grade replicas .They receive wholesale replica handbags, wholesales replica belts, wholesales replica Chanel handbags, wholesale replica Louis Vuitton handbags, wholesales replica Gucci handbags, wholesales replica Balenciaga handbags and wholesales replica bags. We know that the quality of the product directly results in the impression given to people.
wholesale replica handbags
wholesale replica bags
wholesale fake handbags
wholesale fake bags
wholesale cheap handbags
wholesale designer handbags
wholesale replica belts
wholesale replica wallets
wholesale replica Louis Vuitton handbags
wholesale replica Balenciaga handbags
wholesale replica Chanel handbags
wholesale replica Gucci handbags
wholesale replica Fendi handbags
wholesale replica Miumiu handbags
wholesale replica Hermes handbags
wholesale replica Coach handbags

Really a educative and informative post, the post is good in all regards,I am glad to read this post.

http://ezinearticles.com/?Lean-Muscle-X-Review&id=3221720

@Ernie07
And blow all those billable hours. Are you nuts?

Problem with Instant Runoff Voting is sometimes if you get too much support, you can actually loose rather than win. It has happened in political races. Here's an easy description on how:

http://www.youtube.com/watch?v=XEkrFkqIHHI

Word on the street is Weinstein already has election consultants and mathematicians ready to review the system to see if he got screwed.

That is if the Academy will release the votes for independent analysis (which they should with such a complex system)

The algorithms used here are exactly what computers do quite well without requiring coffee breaks or causing eye strain. When will STONE age processing be replaced with software capable of providing reliable and consistent answers?