Sentiment Analysis and Ratings of Professors: A Comparison of Rate-My-Professor and Department Results
DOI:
https://doi.org/10.33423/jhetp.v24i6.7060Keywords:
higher education, text mining, teacher course evaluations, Rate-My-Professor, emotions in textAbstract
Previous studies employing numeric scores have observed that anonymous postings on the Rate-My-Professor (RMP) site tend to be more negative than ratings within a school. In this study, rather than using numeric evaluations, we compared the official UNIV evaluations with the RMP evaluations at the individual faculty course level, employing sentiment analysis on the text comments in evaluations. We compared positive sentiments in ratings on RMP to those in a specific business school department at a university. Our results show a statistically significant difference, with higher positive ratings at the university. We also analyzed emotions using NRC, finding a significant difference, with RMP having higher levels of negative emotions.
References
Altice USA Reports Third Quarter 2021 Results. (2021, November 24). Financial news details. Retrieved from https://investors.alticeusa.com/investors/overview/financial-news-details/2021/Altice-USA-Reports-Third-Quarter-2021-Results/default.aspx
Altice USA. (2021, December 14). In Wikipedia. Retrieved from https://en.wikipedia.org/wiki/Altice_USA
Balkin, D.B., Trevino, L.J., & Straub, S. (2021). The effect of gender inequalities in the classroom and beyond in U.S. business schools. Journal of Management Education. Retrieved from https://doi.org/10.1177/10525629211045604.
Boehmer, D.V., & Wood, W.C. (2017). Student vs faculty perspectives on quality instruction: Gender bias, ‘hotness’, ‘easiness’ in evaluating teaching. Journal of Education for Business, 92(4), 173–178.
Cheddar (TV channel). (2021, October 20). In Wikipedia. Retrieved from https://en.wikipedia.org/wiki/Cheddar_(TV_channel)downloaded from site on Dec 13, 2021
Donovan, J., Mader, C.E., & Shinsky, J. (2006). Constructive student feedback: Online vs. traditional course evaluations. Journal of Interactive Online Learning, 5(3), 283–296.
Felton, J., Micthell, J., & Stinton, M. (2004). Web-based student evaluations of professors: The relations between perceived quality, easiness, and sexiness. Assessment and Evaluation in Higher Education, 29(1), 91–108.
Guder, F., & Malliaris, M. (2010). Online and paper course evaluations. American Journal of Business Education, 3(2), 131–138. https://doi.org/10.19030/ajbe.v3i2.392
Hu, M., & Liu, B. (2004). Mining Opinion Features in Customer Reviews. Retrieved from https://www.aaai.org/Papers/AAAI/2004/AAAI04-119.pdf
Katrompas, A., & Metsis, V. (2021). Rate my professors: A study of bias and inaccuracies in anonymous self-reporting. 2021 2nd International Conference on Computing and Data Science (CDS), pp.536–542. DOI: 10.1109/CDS52072.2021.00098
Kim, C., & Hodge, N. (2000). Professor attitude: Its effect on teaching evaluations. Journal of Management Education, 24(4), 458–473.
Lengauer, G., Esser, F., & Berganza, R. (2011). Negativity in political news: A review of concepts, operationalizations and key findings. Journalism, 13(2), 179–202. https://doi.org/10.1177/146488491142780
Mohammad, S.M., & Turney, P.D. (2013). Crowdsourcing a Word-Emotion Association Lexicon. https://doi.org/10.48550/arXiv.1308.6297
Morrison, K. (2013). Online and paper evaluations of courses: A literature review and case study. Educational Research and Evaluation, 19(7), 585–604. https://doi.org/10.1080/13803611.2013.834608
Nielson, F.A. (2011). Sentiment Analysis (Lexicons). Retrieved from https://rpubs.com/chelseyhill/676279
Otto, J., Sanford, D.A., & Ross, D.N. (2008). Does ratemyprofessor.com really rate my professor? Assessment and Evaluation in Higher Education, 33(4), 355–368.
RateMyProfessors.com. (2021, October 26). In Wikipedia. Retrieved from https://en.wikipedia.org/wiki/RateMyProfessors.com
Rosen, A.S. (2018). Correlations, trends and potential biases among publicly accessible web-based student evaluations of teaching: A large-scale study of RateMyProfessors.com data. Assessment and Evaluation in Higher Education, 43(1), 31–44.
Rozin, P., & Royzman, E.B. (2001). Negativity Bias, Negativity dominance, and contagion. Personality and Social Psychology Review, 5(4), 296–320. doi: 10.1207/S15327957PSPR0504_2
Trussler, M., & Soroka, S. (2014). Consumer demand for cynical and negative news frames. International Journal of Press/Politics, 19(3), 360–379. https://doi.org/10.1177/1940161214524832
Van der Meer, T., Hameleers, M., & Kroon. A. (2020). Crafting our own biased media diets: The effects of confirmation, source, and negativity bias on selective attendance to online news. Mass Communication and Society, 23(6), 937–967. https://doi.org/10.1080/15205436.2020.1782432
