13

According to Wikipedia,

At a 1906 country fair in Plymouth, 800 people participated in a contest to estimate the weight of a slaughtered and dressed ox. Statistician Francis Galton observed that the median guess, 1207 pounds, was accurate within 1% of the true weight of 1198 pounds.[5] This has contributed to the insight in cognitive science that a crowd's individual judgments can be modeled as a probability distribution of responses with the mean centered near the true mean of the quantity to be estimated.

Furthermore, I recall reading in some book, whose title I can't recall, that Galton asked a handful of experts to weigh the ox; he found that both the median and the mean of their estimates to widely deviate from the actual weight.

Did these events happen? Were the results replicated?

11
  • 1
    I seem to recall that there is a term for this in statistics (which I can't remember).
    – GEdgar
    Mar 4, 2016 at 0:59
  • 3
    The question was clearly unanswerable because, as Christian noted, science doesn't "prove" anything. Furthermore, I don't think is meaningful to ask whether a general principle is valid because the only reasonable answer is "it depends". To focus the question I've slightly reworded it to focus on this experiment and its (possible) replication. We'll leave the question on what it actually proves to other forums.
    – Sklivvz
    Mar 4, 2016 at 9:38
  • 3
    I've seen this for counting marbles/candies in a large jar as well, and used this to my advantage at a contest. I waited until just before the deadline, then took the average of all previous guesses. I was close, but not closest (there were only two dozen previous guesses, and it takes a lot of guesses to approximate the mean).
    – gerrit
    Mar 4, 2016 at 11:14
  • 2
    @Sklivvz There are related mathematical proofs, Condorcet's 1785 Jury Theorem and later generalizations, en.wikipedia.org/wiki/Condorcet%27s_jury_theorem
    – DavePhD
    Mar 8, 2016 at 11:58
  • 1
    Stack Overflow have provided an anecdotal counter-example to the idea of wisdom of the crowds.
    – Oddthinking
    Mar 17, 2016 at 10:38

1 Answer 1

20

Yes it really happened, it was the annual show of the West of England Fat Stock and Poultry Society at Plymouth, England. See the below articles for details.

Vox Populi Nature 75, 450-451 (07 March 1907)

(alternative link)

After weeding thirteen cards out of the collection, as being defective or illegible, there remained 787 for discussion. I arrayed them in order of the magnitudes of the estimates, and converted the cwt., quarters, and lbs, in which they were made, into lbs., under which form they will be treated.
...

Now the middlemost estimate is 1207 lb., and the weight of the dressed ox proved to be 1198 lb

The choice of the "middlemost" (median) value, is because his purpose is to evaluate his earlier paper One Vote, One Value Nature vol. 75, page 414 (28 February 1907):

Each voter, whether of the jury or of the council, has equal authority with each of his colleagues. How can the right conclusion be reached, considering that there may be as many different estimates as there are members? That conclusion is clearly not the average of all the estimates, which would give a voting power to “cranks” in proportion to their crankiness. One absurdly large or small estimate would leave a greater impress on the result than one of reasonable amount, and the more an estimate diverges from the bulk of the rest, the more influence would it exert. I wish to point out that the estimate to which least objection can be raised is the middlemost estimate, the number of votes that it is too high being exactly balanced by the number of votes that it is too low. Every other estimate is condemned by a majority of voters as being either too high or too low, the middlemost alone escaping this condemnation.

There were letters to the editor concerning Galton's above articles, and Galton responded to one of those as follows, as published in The Ballot-Box Nature, Vol. 75, pp. 509-510:

MR. HOOKER, in NATURE of March 21, seems not to have quite appreciated my principal contention in the letters "One Vote, One Value" and "Vox Populi" of February 28 and March 7 respectively. It was to show that the verdict given by the ballot-box must be the Median estimate, because every other estimate is condemned in advance by a majority of the voters. This being the case, I examined the votes in a particular instance according to the most appropriate method for dealing with medians, quartiles, &c. I had no intention of trespassing into the technical and much-discussed question of the relative merits of the Median and of the several kinds of Mean, and beg to be excused from not doing so now except in two particulars. First, that it may not be sufficiently realised that the suppression of any one value in a series can only make the difference of one half-place to the median, whereas if the series be small it may make a great difference to the mean; consequently, I think my proposal that juries should openly adopt the median when estimating damages, and councils when estimating money grants, has independent merits of its own, besides being in strict accordance with the true theory of the ballot-box. Secondly, Mr. Hooker's approximate calculation from my scanty list of figures, of what the mean would be of all the figures, proves to be singularly correct; he makes it 1196 lb, (which is the mean of the deviates at 5°, 15° 95°) whereas it should have been 1197 lb.

So initially Galton did not publish the average. Mr. Hooker estimated the average as 1196 lb. based upon the percentile values in the published article. Thereafter Galton published the actual average, which was 1197 lb.

4
  • So why did he use the median rather than the mean? Was this a principled choice? Mar 5, 2016 at 13:40
  • 2
    @PaulJohnson He says "According to the democratic principle of 'one vote one value,' the middlemost estimate expresses the vox populi, every other estimate being condemned at too low or too high by the majority of the voters (for fuller explanation see 'One Vote, One Value,' NATURE, February 28, p.414)"
    – DavePhD
    Mar 6, 2016 at 14:40
  • 3
    @PaulJohnson asks "So why did he use the median rather than the mean? Was this a principled choice?" — The principle appears to be that it isn't the values of the wild guesses themselves that are evenly distributed around the true value, but that there are just as many people that will guess too large as there are that will guess too small. In any large group there will be a few experts that can reliably estimate without guessing, and they will end up in the middle, between too large and too small. The values of the wrong guesses themselves are irrelevant, and their average would be useless. Jan 29 at 15:23
  • @PaulJohnson When there are extreme outliers in a dataset, the median is usually a better representation of the "typical" values in the dataset. The mean is very sensitive to large outliers. Seems like a reasonable choice to me.
    – matt_black
    Jan 31 at 10:42

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .