Thursday, June 17, 2010

You Wish You Were Me

Dave Hoffman on the relative openness of US News Law School rankings:
A few weeks back, Bob Morse issued a stern warning to law school administrators out to game his rankings. In response to a problem created by “openness about our ranking model” Morse took a strong step in the direction of reform by…wait for it…threatening certain schools with punishment for gaming their employed-at-graduation statistic. For those who follow the rankings, this was a particularly galling and obnoxious post. The rankings model isn’t at all “open”: for most categories of concern, USNews engages in hidden manipulations of dubious value which make replicating the results quite difficult. See, e.g., LSAT percentile scoring, COLA adjustments; normalization, treatment of missing data, etc. Indeed, the rankings would likely fail the very low bar for openness and replication set by even a student-edited law journal, let alone a peer reviewed publication.

Oh, burn. Wait ....

(Emphasis is original, by the way)

No comments: