Philosophical Gourmet Report 2002-2004
Brian Leiter's Ranking of Graduate Programs in Philosophy in the English-Speaking World
Spacer1  

Spacer   Spacer
 
Overall Rankings
 

This year's rankings are based on reputational surveys completed by 266 philosophers throughout the English-speaking world (an increase of nearly 50% from 2002). Evaluators were asked to evaluate faculty lists that did not include the university's name along the following dimension:

Please give your opinion of the attractiveness of the faculty for a prospective student, taking in to account (and weighted as you deem appropriate) the quality of philosophical work and talent on the faculty, the range of areas the faculty covers, and the availability of the faculty over the next few years.

Because evaluators do not have reliable access to information about the quality of graduate teaching and mentoring for most departments, this was not a component of the evaluation. As always, students are advised to talk to current students before enrolling at any program.

Evaluators scored departments on the following scale: 5-Distinguished; 4-Strong; 3-Good; 2-Adequate; 1-Marginal; 0-Inadequate for a PhD program. .5 fractions were permitted. There is some difference of opinion as to how faculty size affects the ratings. Many people think (and the editor concurs) that larger faculties fare better in reputational surveys; some think this is an unfair bias (it is simply more likely that an evaluator will know someone on a large faculty), while others think this is a warranted advantage (larger faculties have more to offer). Others believe that per capita quality matters more than size, so that large faculties are at a disadvantage insofar as they may have more underproductive members. Readers may consult the faculty lists used in the evaluation to see how faculties differ in size and composition (i.e., the percentage who are part-time, or affiliated, and so on).

We present, below, two alternative overall rankings of departments, one based on the "scaled" mean score for each department, and one based on the raw mean score. Scores were standardized, to offset any slight distortions resulting from evaluators awarding different average scores (some gave lots of 4s and 5s, some gave almost none), and from not all evaluators scoring all departments. Standardizing the results puts all the evaluators on the same scale. First, the scores were centered by subtracting the mean score for each evaluator from each of that evaluator's scores (each observation); then, each observation was divided by the root-mean-square of that evaluator's scores. After scaling, the distribution of each evaluator's scores has a mean of zero and a variance of one. Note that the scaled scores are for each region, and are not comparable across geographic regions.

While scaling corrects for some distortions, it also introduces some, once again attributable to not all evaluators scoring all departments; when this selective scoring has a fairly systematic pattern (say, the evaluator mostly scores "top" departments, but scores a few lower ranked departments as well), the scaled score of the lower ranked departments will be artificially depressed relative to the raw mean.

In the first ranking, the rank of each department is based on the "overall" scaled mean, i.e., the standardized score of the faculty as rated by all evaluators. The overall scaled mean is followed by the "raw" (unscaled) mean based on all evaluators and then by the total number of evaluators who scored that department. In the next two columns the department's rank in the 2002-04 and 2001-02 Report is given (note, however, that scores were not standardized those years, though scaling, as one can see from the raw scores, has only a modest impact at the margins). The "local" scaled and raw mean reflects the scores given only by evaluators in that national region. There were 161 American evaluators who scored U.S. departments; 49 U.K. evaluators who scored U.K. departments (a 75% increase from 2002); 19 Canadian evaluators who scored Canadian departments (a 25% increase from 2002); and 15 Australasian evaluators who scored Australasian departments (a 90% increase from 2002). In the second set of rankings, the rank of each department is based on the "overall" raw mean, and then the rest of the data is as before. The rankings are unchanged for Australasia , whether raw or scaled mean is used, so we print only one set of rankings for that region. For purposes of comparing rank this year with prior years, it makes more sense to look at the raw mean ranking. For purposes of comparing departments across geographic regions, one must also look to raw mean, since scaling was done relative to departments in that geographic region.

Rankings by Scaled Mean

United States Scaled Overall Mean Raw Overall Mean Total # of Evaluators Rank in 2002 Rank in 2001 Scaled Local Mean Raw Local Mean
1 New York University 1.9 4.8 234 1 1 2.0 4.8
2 Rutgers University, New Brunswick 1.8 4.7 211 1 3 1.9 4.7
3 Princeton University 1.5 4.5 213 1 1 1.6 4.4
4 University of Michigan, Ann Arbor 1.4 4.3 215 4 4 1.5 4.3
  University of Pittsburgh 1.4 4.3 217 5 5 1.5 4.3
6 Columbia University 1.0 4.0 222 7 9 1.0 3.8
  Harvard University 1.0 3.9 216 8 6 1.0 3.8
  Massachusetts Institute of Technology 1.0 4.0 226 8 9 1.1 4.0
  Stanford University 1.0 4.0 225 6 6 1.2 4.0
  University of California, Los Angeles 1.0 3.9 216 8 8 1.0 3.8
11 Cornell University 0.8 3.7 200 16 9 0.8 3.7
  University of North Carolina, Chapel Hill 0.8 3.7 214 12 12 0.8 3.6
  University of Notre Dame 0.8 3.7 217 14 14 0.8 3.7
  University of Texas, Austin 0.8 3.8 224 14 17 0.8 3.7
15 University of California, Berkeley 0.7 3.7 219 13 13 0.8 3.6
16 University of Arizona 0.6 3.6 220 8 14 0.7 3.6
17 University of California, Irvine 0.5 3.4 207 20 17 0.5 3.4
18 City University of New York Grad Center 0.4 3.4 229 25 24 0.3 3.2
  University of California, San Diego 0.4 3.4 206 20 17 0.4 3.3
  University of Chicago 0.4 3.4 219 16 17 0.4 3.3
21 Brown University 0.3 3.4 219 16 16 0.4 3.3
  Ohio State University 0.3 3.2 207 22 22 0.3 3.1
23 University of Southern California 0.2 3.1 197 46 41 0.2 3.1
  University of Wisconsin, Madison 0.2 3.2 211 22 24 0.2 3.1
25 University of Maryland, College Park 0.1 3.1 215 30 31 0.0 3.0
  Yale University 0.1 3.1 203 16 17 0.1 2.9
27 University of California, Davis 0.0 3.1 212 24 24 0.0 3.0
  University of Massachusetts, Amherst 0.0 3.0 204 30 28 0.0 2.9
29 Duke University -0.1 2.9 205 28 30 -0.1 2.8
  Indiana University, Bloomington -0.1 2.9 197 25 26 0.0 2.8
  University of California, Riverside -0.1 2.8 189 32 31 0.0 2.8
32 Syracuse University -0.2 2.8 195 32 39 -0.2 2.7
  University of Pennsylvania -0.2 2.8 204 25 26 -0.1 2.8
34 Carnegie-Mellon University -0.3 2.6 186 36 37 -0.3 2.5
  University of Illinois, Chicago -0.3 2.7 201 36 31 -0.2 2.7
  University of Minnesota, Twin Cities -0.3 2.6 194 32 31 -0.3 2.5
  University of Washington, Seattle -0.3 2.6 190 32 31 -0.2 2.5
38 University of Colorado, Boulder -0.4 2.6 198 28 28 -0.4 2.4
  University of Virginia -0.4 2.7 194 42 42 -0.3 2.6
  Washington University, St. Louis -0.4 2.6 196 not in the top 50 not in the top 50 -0.3 2.6
41 Georgetown University -0.5 2.4 184 42 42 -0.5 2.4
  Johns Hopkins University -0.5 2.4 203 36 31 -0.5 2.4
  Northwestern University -0.5 2.3 197 46 37 -0.5 2.4
  Rice University -0.5 2.3 195 39 42 -0.5 2.4
  University of California, Santa Barbara -0.5 2.4 188 40 42 -0.4 2.4
  University of Florida, Gainesville -0.5 2.5 192 n/a n/a -0.5 2.4
47 Arizona State University -0.6 2.5 182 46 not in the top 50 -0.6 2.3
  Boston University -0.6 2.5 192 42 42 -0.7 2.1
  University of Connecticut, Storrs -0.6 2.4 189 40 42 -0.7 2.2
  University of Rochester -0.6 2.4 181 46 48 -0.6 2.3
  Runners-Up for the U.S. Top 50              
  Florida State University -0.7 2.4 210 n/a n/a -0.6 2.3
  University of Illinois, Urbana-Champaign -0.7 2.2 183 42 49 -0.7 2.2
  University of Miami -0.7 2.4 210 46 39 -0.8 2.2
  Tulane University -0.9 2.1 183 not in the top 50 not in the top 50    
  University of Missouri, Columbia -0.9 2.1 181 n/a n/a -0.8 2.2

 

United Kingdom ScaledMean Raw Mean Total # of Evaluators 2002 Rank Scaled Local Mean Raw Local Mean
1 Oxford University 1.8 4.6 184 1 1.8 4.8
2 Cambridge University 0.7 3.7 193 2 1.1 4.2
3 Universities of St. Andrews 0.5 3.5 182 3 0.7 3.9
4 University College London 0.3 3.3 169 7 0.6 3.8
5 Birkbeck College, London 0.1 3.0 171 4 0.1 3.4
  King’s College, London 0.1 3.1 174 4 0.5 3.7
7 University of Sheffield 0.0 2.9 147 10 0.4 3.7
8 London School of Economics -0.1 2.9 156 7 0.0 3.2
9 University of Reading -0.2 2.8 160 4 -0.2 3.2
10 University of Edinburgh -0.5 2.4 152 9 -0.4 3.0
  University of Leeds -0.5 2.4 147 11 -0.3 3.0
  University of Nottingham -0.5 2.3 143 15 -0.4 3.0
  University of Warwick -0.5 2.5 137 n/a -0.5 2.8
14 University of Bristol -0.7 2.2 157 not in the top 15 -0.5 2.8
15 University of Glasgow -0.8 2.1 150 12 -1.0 2.5
  Runners-Up for the U.K. Top 15            
  University of Durham -1.0 1.9 135   -1.0 2.5
  University of York -0.9 2.0 135   -0.7 2.7
  Aggregated Faculties            
  University of London (all colleges) 1.3 4.2 187   1.4 4.4
  University of St. Andrews/University of Stirling Joint Program 0.7 3.7 185   0.9 4.0

Note: Although housed at separate institutions and evaluated separately, St. Andrews and Stirling run a joint graduate program.

Canada Scaled Mean Raw Mean Total # of Evaluators 2002 Rank Scaled Local Mean Raw Local Mean
1 University of Toronto 1.6 3.5 179 1 1.9 3.9
2 University of Western Ontario 0.3 2.5 126 2 0.8 3.0
3 University of British Columbia 0.2 2.5 145 3 0.5 2.7
4 McGill University 0.0 2.4 133 3 0.0 2.5
5 University of Alberta -0.2 2.2 132 5 -0.2 2.4
6 Simon Fraser University -0.3 2.1 134 n/a -0.6 2.2
  Queen's University -0.3 2.1 121 n/a 0.0 2.5
8 Tri-University Ph.D. Program -0.4 1.9 112 n/a -0.4 2.2
  University of Waterloo -0.4 2.0 120 n/a -0.8 2.0
  York University, Toronto -0.4 2.0 115 n/a -0.6 2.2
  Runner-Up for the Top 10            
  University of Calgary -0.5 1.9 122 n/a -0.2 2.4

 

Australasia Scaled Mean Raw Mean Total # of Evaluators 2002 Rank Scaled Local Mean Raw Local Mean
1 Australian National University 1.5 4.0 184 1 1.7 4.4
2 University of Melbourne 0.2 2.9 138 2 0.2 3.2
3 University of Sydney 0.1 2.8 139 5 0.1 3.2
4 University of Auckland -0.2 2.6 143 3 0.6 3.4
5 Monash University -0.3 2.4 130 3 -0.1 3.0
  University of Queensland -0.3 2.4 125 not in top 5 -0.4 2.9

 

Rankings by Raw Mean

United States Raw Overall Mean Scaled Overall Mean Total # of Evaluators Rank in 2002 Rank in 2001 Scaled Local Mean Raw Local Mean
1 New York University 4.8 1.9 234 1 1 2.0 4.8
2 Rutgers University, New Brunswick 4.7 1.8 211 1 3 1.9 4.7
3 Princeton University 4.5 1.5 213 1 1 1.6 4.4
4 University of Michigan, Ann Arbor 4.3 1.4 215 4 4 1.5 4.3
  University of Pittsburgh 4.3 1.4 217 5 5 1.5 4.3
6 Columbia University 4.0 1.0 222 7 9 1.0 3.8
  Massachusetts Institute of Technology 4.0 1.0 226 8 9 1.1 4.0
  Stanford University 4.0 1.0 225 6 6 1.2 4.0
9 Harvard University 3.9 1.0 216 8 6 1.0 3.8
  University of California, Los Angeles 3.9 1.0 216 8 8 1.0 3.8
11 University of Texas, Austin 3.8 0.8 224 14 17 0.8 3.7
12 Cornell University 3.7 0.8 200 16 9 0.8 3.7
  University of California, Berkeley 3.7 0.7 219 13 13 0.8 3.6
  University of North Carolina, Chapel Hill 3.7 0.8 214 12 12 0.8 3.6
  University of Notre Dame 3.7 0.8 217 14 14 0.8 3.7
16 University of Arizona 3.6 0.6 220 8 14 0.7 3.6
17 Brown University 3.4 0.3 219 16 16 0.4 3.3
  City University of New York Grad Center 3.4 0.4 229 25 24 0.3 3.2
  University of California, Irvine 3.4 0.5 207 20 17 0.5 3.4
  University of California, San Diego 3.4 0.4 206 20 17 0.4 3.3
  University of Chicago 3.4 0.4 219 16 17 0.4 3.3
22 Ohio State University 3.2 0.3 207 22 22 0.3 3.1
  University of Wisconsin, Madison 3.2 0.2 211 22 24 0.2 3.1
24 University of California, Davis 3.1 0.0 212 24 24 0.0 3.0
  University of Maryland, College Park 3.1 0.1 215 30 31 0.0 3.0
  University of Southern California 3.1 0.2 197 46 41 0.2 3.1
  Yale University 3.1 0.1 203 16 17 0.1 2.9
28 University of Massachusetts, Amherst 3.0 0.0 204 30 28 0.0 2.9
29 Duke University 2.9 -0.1 205 28 30 -0.1 2.8
  Indiana University, Bloomington 2.9 -0.1 197 25 26 0.0 2.8
31 Syracuse University 2.8 -0.2 195 32 39 -0.2 2.7
  University of California, Riverside 2.8 -0.1 189 32 31 0.0 2.8
  University of Pennsylvania 2.8 -0.2 204 25 26 -0.1 2.8
34 University of Illinois, Chicago 2.7 -0.3 201 36 31 -0.2 2.7
  University of Virginia 2.7 -0.4 194 42 42 -0.3 2.6
36 Carnegie-Mellon University 2.6 -0.3 186 36 37 -0.3 2.5
  University of Colorado, Boulder 2.6 -0.4 198 28 28 -0.4 2.4
  University of Minnesota, Twin Cities 2.6 -0.3 194 32 31 -0.3 2.5
  University of Washington, Seattle 2.6 -0.3 190 32 31 -0.2 2.5
  Washington University, St. Louis 2.6 -0.4 196 not in the top 50 not in the top 50 -0.3 2.6
41 Arizona State University 2.5 -0.6 182 46 not in the top 50 -0.6 2.3
  Boston University 2.5 -0.6 192 42 42 -0.7 2.1
  University of Florida, Gainesville 2.5 -0.5 192 n/a n/a -0.5 2.4
44 Florida State University 2.4 -0.7 210 n/a n/a -0.6 2.3
  Georgetown University 2.4 -0.5 184 42 42 -0.5 2.4
  Johns Hopkins University 2.4 -0.5 203 36 31 -0.5 2.4
  University of California, Santa Barbara 2.4 -0.5 188 40 42 -0.4 2.4
  University of Connecticut, Storrs 2.4 -0.6 189 40 42 -0.7 2.2
  University of Miami 2.4 -0.7 210 46 39 -0.8 2.2
  University of Rochester 2.4 -0.6 181 46 48 -0.6 2.3
  Runners-Up for the U.S. Top 50              
  Northwestern University 2.3 -0.5 197 46 37 -0.5 2.4
  Rice University 2.3 -0.5 195 39 42 -0.5 2.4
  University of Illinois, Urbana-Champaign 2.2 -0.7 183 42 49 -0.7 2.2
  Tulane University 2.1 -0.9 183 not in the top 50 not in the top 50    
  University of Missouri, Columbia 2.1 -0.9 181 n/a n/a -0.8 2.2

 

United Kingdom Raw Mean Scaled Mean Total # of Evaluators 2002 Rank Scaled Local Mean Raw Local Mean
1 Oxford University 4.6 1.8 184 1 1.8 4.8
2 Cambridge University 3.7 0.7 193 2 1.1 4.2
3 Universities of St. Andrews 3.5 0.5 182 3 0.7 3.9
4 University College London 3.3 0.3 169 7 0.6 3.8
5 King’s College, London 3.1 0.1 174 4 0.5 3.7
6 Birkbeck College, London 3.0 0.1 171 4 0.1 3.4
7 London School of Economics 2.9 -0.1 156 7