RateMyProfessors.com

RateMyProfessors.com versus formal in-class student evaluations

Using data for 426 instructors at the University of Maine, [researchers] examined the relationship between RMP indices and formal in-class student evaluations of teaching (SET). This study found that the two primary RMP indices correlated significantly with their respective SET items. First, RMP "overall quality" showed a correlation of r = .68 with SET item "Overall, how would you rate the instructor?" Second, RMP "ease" showed a correlation of r = .44 with SET item "How did the work load for this course compare to that of others of equal credit?" Further, RMP "overall quality" (r = .57) and RMP "ease" (r = .51) were each correlated with its corresponding SET factor derived from a principal components analysis of all 29 SET items. The researchers concluded "While these RMP/SET correlations should give pause to those who are inclined to dismiss RMP indices as meaningless, the amount of variance left unexplained in SET criteria limits the utility of RMP.".^[8]

Positive correlation between easiness of class and rating of professor

Research on in-class evaluations shows that professor ratings increase when students rate the course as easy.^[9] The same relationship has been shown for RMP. In an article in the journal Assessment and Evaluation in Higher Education, Clayson investigated what RMP actually rates and concluded that "students will give higher evaluations to instructors they judge as being easy. There is also a suggestion in these findings that, if students like an instructor (for whatever reason), then the easiness of the class becomes relatively irrelevant."^[10]. Clayson concluded that "the majority of the evidence indicates that [ratemyprofessors.com] is biassed by a halo effect, and creates what most accurately could be called a 'likeability' scale." Other analyses of RMP class ratings have come to similar conclusions,^[11][12][13] and some have concluded that professor attractiveness is also positively correlated with evaluation scores on RMP.^[14] Felton et al. evaluated RMP ratings and found that "the hotter and easier professors are, the more likely they’ll get rated as a good teacher."^[15]

Evaluation bias issues

A frequent criticism of RMP is that there is little reason to think that the ratings accurately reflect the quality of the professors rated.^[16][17] Another criticism is that ratings have been shown to reflect gender bias toward the professors evaluated.^[18] Furthermore, at RMP, "easiness", "clarity", and "helpfulness" are the only components taken into consideration and are not considered well-designed evaluations.^[19][20] Edward Nuhfer argues that both Pickaprof.com and RMP "are transparently obvious in their advocacy that describes a 'good teacher' as an easy grader. Additionally, presenter Phil Abrami ... rated RMP as 'The worst evaluation I've seen' during a panel discussion on student evaluations at the 2005 annual AERA meeting."^[21]

Edward Nuhfer has argued, "Pseudo-evaluation damages the credibility of legitimate evaluation and victimizes individuals by irresponsibly publishing comments about them derived from anonymous sources. This is voyeurism passed off as 'evaluation' and examples lie at PickAProf.com and RateMyProfessors.com. Neither site provides evaluation of faculty through criteria that might be valuable to a student seeking a professor who is conducive to their learning, thinking or intellectual growth."^[22]

Multiple ratings per person

Single individuals are able to make multiple separate ratings of a single professor on RMP.^[23] RMP admits ^[24] that while it does not allow such multiple ratings from any one IP address, it has no control over raters who use several different computers, or those that "spoof" IP addresses. Also, there is no way of knowing that those who rate a professor's course have actually taken the course in question, making it possible for professors to rate themselves and each other.^[25]

Rating relevancy

Critics stated that a number of the ratings focus on qualities they see as irrelevant to teaching, such as physical appearance.^[26] In late June 2018, several academics criticized the website's "hotness" score for contributing to sexism in academia. On 28 June, RateMyProfessor responded that while the feature was intended to "reflect a dynamic/exciting teaching style," it was often misused; the hotness rating was removed immediately.^[27]

It is common at universities and colleges for faculty (especially junior faculty) to be called on by their departments to teach courses on topics that are not within their area(s) of expertise, which can earn them poor ratings at RMP that do not reflect the ability of those professors to teach courses on subjects that they are much more qualified to teach. RateMyProfessors, though it lets the student identify the course that they took with the professor, combines the ratings for all courses taught by each professor, instead of providing separate ratings averages for each course taught.

Permanent vs adjunct faculty

Adjunct faculty are not always readily identifiable nor verifiable, as such professors may work at multiple universities, change universities frequently, or maintain employment outside an academic setting..

Updates to website

RMP regularly modifies its site to reflect student preferences. In late 2011, professors were given the ability to make their Twitter handle available on their professor profile pages for students to follow. In 2014, RMP debuted a new responsive site design. In 2015, the site introduced custom URL's, which allows professors to create a custom URL for their ratings page.

Professor Notes

After mtvU took over the website, a notes feature was added that allows professors to register with the website (using a ".edu" e-mail address) in order to reply to students' comments. Another option, called "Professors Strike Back", featured videos of professors responding to their ratings on RMP.^[30] Additionally, in 2015, the site debuted a new series "Professors Read Their Ratings"^[31] in which professors read and react to their RMP ratings. Students may also submit videos to RMP.^[32]

School ratings

Students can also comment on and rate their school by visiting their school's RMP school page. School Ratings categories include Academic Reputation, Location, Campus, School Library, Food, Clubs & Activities, Social Events, and Happiness.

Top Lists

RMP annually compiles Top Lists of the Highest Rated Professors and Top Schools in the U.S. based on ratings and comments from students.^[33] For the first time, along with the release of their 2011-2012 Top Lists, RMP debuted its "Fun Lists."

Recognition

In 2008 RMP was recognized by Time Magazine as one of the 50 best websites of 2008.

In 2008, student evaluations of Professors from RMP accounted for 25% of a school's rating in Forbes annual "America's Best Colleges" listing. However, this is no longer true.^[34]

In 2015, the site won two People's Choice Webby Awards after an extensive site overhaul.^[35]