واکاوی ارتباط میان تورم نمرات با ارزشیابی دانشجویان از تدریس اساتید

نشریه علمی آموزش و ارزشیابی (فصلنامه)

دوره 15، شماره 60، اسفند 1401، صفحه 107-133   

نوع مقاله: مقاله پژوهشی

شناسه دیجیتال (DOI): 10.30495/jinev.2023.1974151.2811

نویسندگان

سیداحمد مدنی¹؛ علی قاسم‌پور^{* 2}

¹استادیار گروه علوم تربیتی، دانشکدة علوم انسانی، دانشگاه کاشان، کاشان، ایران.

²استادیار گروه علوم تربیتی، دانشگاه پیام‌نور، تهران، ایران.

چکیده

هدف این پژوهش واکاوی ارتباط میان نمرات پیشرفت تحصیلی دانشجویان با ارزشیابی آنها از تدریس اساتید بود. طرح طولی تحقیق از نوع مطالعات پنلی است که در آن طی فواصل زمانی مشخص اندازه‌گیری‌های لازم انجام می‌شود. دانشجویان شاغل به تحصیل در سه نیمسال پیش از شرایط آموزش مجازی جامعة آماری این تحقیق بوده‌اند. حجم نمونه با نرم‌افزار جی‌پاور و بر اساس آزمون‌های آماری تعیین شد. پس از شرط‌گذاری و غربال بیش از یکصدهزار جفت «نمرة دانشجو-ارزشیابی استاد»، تحلیل نهایی روی داده‌های مربوط به 1970 دانشجو انجام شد که در سه نیمسال متوالی با یک استاد درس گرفته بودند. ابزار گردآوری داده‌های ارزشیابی اساتید، فرم رسمی مؤسسه در نیمسال‌های مورد نظر بوده است. تحلیل‌ها نشان داد با افزایش نمرة پایان‌ترم دانشجو، نمرة ارزشیابی او از استاد در نیمسال بعد افزایش معناداری پیدا می‌کند. تحلیل تکمیلی مشخص ساخت که اثر نمرة اولیه تا دو نیمسال بعد نیز پایدار می‌ماند، به نحوی که می‌توان گفت با یک واحد افزایش در نمرة پایان‌ترم دانشجویان، پس از دو نیمسال افزایش معناداری بین 1 تا 4 درصد در نمرة ارزشیابی آنها از استادان قابل مشاهده است. ضرایب رگرسیونی ارتباط معدل کل کلاس با ارزشیابی تدریس استادان نیز در حالت دو نیمسال متوالی معنادار بود. سرانجام، تحلیل‌ها بر روی نمرات دروس تخصصی و اصلی دانشجویان نشان داد، در مقایسه با گذشته، در گروه‌ رشته‌های علوم انسانی، ادبیات و معماری و هنر تورم نمره وجود دارد. بر اساس این شواهد پیشنهاد شده است که پدیدة تورم نمرات از منظر ارتباط احتمالی آن با نحوة بهره‌برداری از ارزشیابی‌های دانشجویی در تصمیم‌گیری‌های استخدامی و دانشگاهی اعضای هیات علمی مورد تأمل قرار گیرد. 

کلیدواژه‌ها

ارزشیابی؛ تدریس؛ ارزشیابی تدریس؛ دانشجویان؛ استادان؛ پیشرفت تحصیلی

مراجع

شیخ الاسلامی، ندا.، یونسی، جلیل.، و دلاور، علی. (1400). پیامدهای تورم نمره در آموزش عالی و راهکارهای مقابله با آن. اندیشه های نوین تربیتی، 17(1 )، 7-38.

ضیایی، مسعود.، میری، محمدرضا.، حاجی آبادی، محمدرضا.، آذرکار، سیده قدسیه.، و پویا اشیک(1386). دیدگاه اساتید و دانشجویان دانشگاه علوم پزشکی بیرجند نسبت به ارزشیابی اساتید توسط دانشجو. مجله علمی دانشگاه علوم پزشکی بیرجند، 13(4)، 9-15.

کریمی، منوچهر.، و احمدی، سیدعلی اکبر. (1400). ارایه مدل شایستگی اختصاصی استادان دانشگاه. آموزش و ارزشیابی، 14 (53)، 159-180. 

محمدی خوانقاهی، محمد.، و حسین‌زاده، امیدعلی. (1394). تدوین و اعتباریابی مدل تدریس اثربخش برای اساتید دانشگاه تبریز. آموزش و ارزشیابی، 8 (31)، 71-91. 

کمالی، یحیی.، و پورچناری، عبدالله. (1394). بررسی ویژگی‌های استاد خوب از دیدگاه دانشجویان علوم سیاسی دانشگاه شهید باهنر کرمان. آموزش و ارزشیابی، 8 (30)، 117-140. 

محسن‌زاده کریمی، ساناز.، ادیب، یوسف.، و حسینی، محمدحسین. (1391). مقایسه عوامل آموزشی موثر بر کیفیت آموزشی دانشکده علوم انسانی دانشگاه آزاد اسلامی واحد تبریز از دیدگاه استادان و دانشجویان. فصلنامه علوم تربیتی، 5 (18)، 121-136.

هادی، رضا.، رضاپور، یوسف.، و سلمان‌پور، صدیقه. (1395). شاخص‌های سنجش کیفیت آموزش عالی بر اساس مدل کانو در دانشگاه ارومیه. آموزش و ارزشیابی، 9 (34)، 35-50.

یارمحمدزاده، پیمان.، فیضی، ایوب.، محمدیان، کویستان.، آق‌آتابای، آمنه. (1396). رابطه ویژگی‌های شخصیت و سبک رهبری کلاس درس با کیفیت تدریس اساتید دانشگاه به روش خودارزیابی، ارائة یک مدل ساختاری. آموزش و ارزشیابی، 10 (39)، 29-51.

Adams, Gary. L., & Engelmann, Siegfried. (1996). Research on Direct Instruction: 25 Years Beyond DISTAR. Seattle: Educational Achievement Systems.

Addison, W. E., Best, J., & Warrington, J. D. (2006). Students’ perceptions of course difficulty and their ratings of the instructor. College Student Journal, 40 (-): 409-416.

Alauddin, M., & T. Kifle. (2014). Does the Student Evaluation of Teaching Instrument Really Measure Instructors’ Teaching Effectiveness? An Econometric Analysis of Students’ Perceptions in Economics Courses. Economic Analysis and Policy, 44(2): 156-168. doi:10.1016/j.eap.2014.05.009.

Atanasio, M., & Capursi, V. (Editors), (2011) Statistical Methods for the Evaluation of University Systems. Berlin, Heidelberg: Springer. 

Bachen, Christine. M., McLoughlin, Moira. M., & Garcia, Sara. S. (1999). Assessing the role of gender in college students’ evaluations of faculty. Communication Education, 48(3): 193-210.

Bar, T., Kadiyali, V., & Zussman, A. (2009). Grade Information and Grade Inflation: The Cornell Experiment. The Journal of Economic Perspectives, 23(3): 93-108.

Beenstock, M., & Feldman, D. (2016). Decomposing university grades: a longitudinal study of students and their instructors. Studies in Higher Education, DOI: 10.1080/03075079.2016.1157858

Beran, T., & Violato, C. (2009). Student ratings of teaching effectiveness: Student engagement and course characteristics. Canadian Journal of Higher Education, 39(1): 1-13.

Berezvai, Z., Lukats, Gergely. D., & Molontay, R. (2020). Can professors buy better evaluation with lenient grading? The effect of grade inflation on student evaluation of teaching. Assessment & Evaluation in Higher Education, DOI:10.1080/02602938.2020.1821866

Boysen, Guy. A., Kelly, Timothy. J., Raesly, Holly. N., & Casner, Robert. W. (2014). The (mis)interpretation of teaching evaluations by college faculty and administrators, Assessment & Evaluation in Higher Education, 39(6): 641-656.

Buller, Jeffrey. L. (2012). Best practices in faculty evaluation: A Practical guide for academic leaders. San Francisco. Jossey-Bass.

Brookhart, Susan. M. (2016). A Century of Grading Research: Meaning and Value in the Most Common Educational Measure. Review of Educational Research, Vol. XX, No. X, pp. 1–46. 

Carey, Th., & Carifio, J. (2012). The Minimum Grading Controversy: Results of a Quantitative Study of Seven Years of Grading Data from an Urban High School. Educational Researcher, 41(6): 201-208.

Chowdhury, F. (2018). Grade Inflation: Causes, Consequences and Cure. Journal of Education and Learning, 7(6): 86-92.

Chang, K., & Coutinho, Lucas de Lemos. (2021). Administering Homework Self-Grading for an Engineering Course. College Teaching, DOI: 10.1080/87567555.2021.1957666

Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education, 31(1): 16-30.

Coffey, M., & Gibbs, G. (2001). The Evaluation of the Student Evaluation of Educational Quality Questionnaire (SEEQ) in UK Higher Education. Assessment & Evaluation in Higher Education, 26(1): 89-93.

Cunningham, Samuel., Laundon, Melinda., Cathcart, Abby., Bashar, Md Abul., & Nayak, Richi. (2022). First, do no harm: automated detection of abusive comments in student evaluation of teaching surveys. Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2081668

Danielson, Charlotte., & McGreal, Thomas. L. (2000). Teacher evaluation to enhance professional practice. Princeton, NJ: Association for Supervision and Curriculum Development.

Felix, E. D., Binmoeller, C., Sharkey, J. D., Dowdy, E., Furlong, M. J., & Latham, N. (2018). The influence of different longitudinal patterns of peer victimization on psychosocial adjustment. Journal of School Violence, 1-15.

Gerzeli, Simone. (2011). The Impact of Teaching Evaluation: Factors that Favour Positive Views from Student Representatives. In: Massimo Attanasio & Vincenza Capursi (Editors), Statistical Methods for the Evaluation of University Systems. Berlin, Heidelberg: Springer. 

Golzio, Luigi. Enrico. (2011). The Assessment of University Teaching by Students: The

Hadi, R., Rezapoor, Y., & salmanpoor, S. (2016). Evaluation Indexes in Higher Education Based on Kano`s Model at Urmia University. Journal of Instruction and Evaluation, 9(34): 35-50 [In Persian].

Hailperirn, Mlax. (1982). SCC worth jumps despite cash logs. The Tech, 102(1): 1-24.

Harris, Gregory. A. (2011). The Impact of Hidden Grades on Student Decision-Making and Academic Performance: An Examination of a Policy Change at MIT. Toronto, Ontario: AIR Forum. 

Hattie, John. (2009). Visible learning: A synthesis of over 800 meta-analysis relating to achievement. New York: Routledge.

Herman, Joan., & Cook, Linda. (2019). Fairness in Classroom Assessment. In: Susan Brookhart & James McMillan (Editors): Classroom Assessment and Educational Measurement. New York: Routledge.

Jephcote, C., Medland, E., & Lygo-Baker, S. (2020). Grade inflation versus grade improvement: Are our students getting more intelligent? Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2020.1795617

Johnson, R. Burke., & Christensen, Larry. (2016). Educational research: Quantitative, qualitative, and mixed approaches. Los Angleles: Sage.  

Kaplan, D. S., Liu, X., & Kaplan, H. B. (1995). Explaining Dropout Behavior: A Longitudinal Study of Direct and Indirect Psychosocial Effects of Seventh and Eighth Grade Experiences. Educational Research and Evaluation, 1(3): 205-225.

Karimi, M., and Ahmadi S. (2021) Providing Exclusive Competency Model for University Faculty Members. Journal of Instruction and Evaluation, 14(53): 159-180. [In Persian].

Kamali, Y., Pourchenary, A. (2015). The Characteristics of a Good Teacher from the Political Sciences Students’ Point of view at Shahid Bahonar University of Kerman. Journal of Instruction and Evaluation, 8(30): 21179-140. [In Persian].

Lakeman, Richard., Coutts, Rosanne., Hutchinson, Marie., Lee, Megan., Massey, Debbie., Nasrawi, Dima., & Fielden, Jann. (2021). Appearance, insults, allegations, blame and threats: an analysis of anonymous non-constructive student evaluation of teaching in Australia, Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2021.2012643

Landrum, R. Eric., & Braitman, Keli. A. (2008). The effect of decreasing response options on students' evaluation of instruction. College Teaching, 56(4): 215-217.

Lastusaari, Mika., Laakkonen, Eero., & Murtonen, Mari. (2019). Persistence in studies in relation to learning approaches and first-year grades: a study of university chemistry students in Finland. Chem Educ. Res. Pract, 20(3): 452-467.

Linse, Angela. R. (2016). Interpreting and using student ratings data: Guidance for faculty serving as administrators and on evaluation committees. Studies in Educational Evaluation, 54: 94-106. 

Maamari, B. E., & Naccache, H. S. (2022). The impact of grade inflation on teachers’ evaluation: A quantitative study conducted in the context of five Lebanese universities. Journal of Global Education and Research, 6(2): 192-205.

Mackinnon, Sean. P., & Kashif, Shazia. (2022). A Short History of Grading Practices at Dalhousie University (1901-2021). PeerRef, 10.35542/osf.io/fmgv8

Marsh, Herbert. W. (1977). The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated as Best and Worst Teachers by Graduating Seniors. American Educational Research Journal, 14(4): 441.

Marsh, Herbert. W., & Overall, Jesse. U., & Kesler, Steven. P. (1979). Long-Term Stability of Students’ Evaluations: A Note on Feldman’s “Consistency and Variability among College Students in Rating Their Teachers and Courses. Research in Higher Education, 10(2): 139–147.

Marsh, Herbert. W. (1982). Factors Affecting Students' Evaluations of the Same Course Taught by the Same Instructor on Different Occasions. American Educational Research Journal, 19(4): 485-497.

Marsh, Herbert. W. (2001). Distinguishing between Good (Useful) and Bad Workloads on Students’ Evaluations of Teaching. American Educational Research Journal, 38(1): 183-212.

Marsh, Herbert. W. (1977). The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated as Best and Worst Teachers by Graduating Seniors. American Educational Research Journal, 14(4): 441-447.

Marsh, Herbert. W., & Roche, Lawrence. (1993). The Use of Students' Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness. American Educational Research Journal, 30(1): 217-251.

McEwan, Patrick. j., & et al. (2006). Roommate effects on grades: evidence from first-year housing assignments. Research in higher education, 47(3): 347-370.

McMillan, Amy., Solanelles, Pol., & Rogers, Bryan. (2021). Bias in student evaluations: Are my peers out to get me? Studies in Educational Evaluation, 70 (101032): 1-11. 

Marshall, Kim. (2009). Rethinking teacher supervision and evaluation: How to work smart, build collaboration, and close the achievement gap. San Francisco: Jossey-Bass.

Marshall, Pablo. (2022). Contribution of open-ended questions in student evaluation of teaching. Higher Education Research & Development, 4(6): 1992-2005.

Martínez, José. Felipe., Schweig, Jonathan., & Goldschmidt, Pete. (2016). Approaches for Combining Multiple Measures of Teacher Performance: Reliability, Validity, and Implications for Evaluation Policy. Educational Evaluation and Policy Analysis, 38(4): 738-756.

Mengel, Friederike., Sauermann, Jan., & Zolitz, Uif. (2019). Gender Bias in Teaching Evaluations. Germany: IZA Institute of Labor Economics.

MIT. (2000). Freshman pass/no record grading and advanced placement policy: Report of a special subcommittee on the Committee on the Undergraduate Program. Cambridge, Massachusetts: The Massachusetts Institute of Technology.

Mohammadi khanghahi, M., & Hosinzadeh, O. (2015) Presenting and Verifying an Effective Teaching Model for Teachers at Tabriz University. Journal of Instruction and Evaluation, 8(31): 71-91 [In Persian].

Mohsenzade karimi, S., Adib, y., & Hoseini, M. (2012). The comparison study of educational factors affecting the educational quality of human science faculty from professors and student’s points of view, Tabriz Islamic Azad University, Journal of Instruction and Evaluation, 5(18): 121-136. [In Persian].

Morin, A. J. S., & Marsh, H. W. (2014). Disentangling Shape from Level Effects in Person-Centered Analyses: An Illustration Based on University Teachers’ Multidimensional Profiles of Effectiveness. Structural Equation Modeling: A Multidisciplinary Journal, 22(1): 39-59.

Muller-Benedict, Volker., & Gaens, Thomas. (2020). A new explanation for grade inflation the long-term development of German university grades, European Journal of Higher Education, DOI: 10.1080/21568235.2020.1718516

Nevid, Jeffrey. S. (2018). Essentials of Psychology: Concepts and Applications. Australia: CENGAGE Learning.

Nolan, James. H., & Hoover, Linda. A. (2008). Teacher supervision & Evaluation: Theory into Practice. Wiley.

Park, Byungjin., & Cho, Joonmo. (2022). How does grade inflation affect student evaluation of teaching? Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2126429

Radmacher, Sally. A., & Martin, David. J. (2001). Identifying Significant Predictors of Student Evaluations of Faculty Through Hierarchical Regression Analysis. The Journal of Psychology: Interdisciplinary and Applied, 135(3): 259-268.

Reed, W. R., & Ye, H. (2011). Which panel data estimator should I use? Applied Economics, 43(8): 985-1000.

Schmelkin, Liora. Pedhazur., Spencer, Karin. J., & Gellman, Estelle. S. (1997). Faculty Perspectives on Course and Teacher Evaluations. Research in Higher Education, 38(5): 575-592.

Sheikholeslami, N., Younesi, J., & Delavar. Ali (2021). The consequences of grade inflation in higher education and the strategies to deal with it. Quarterly Journal of New Thoughts on Education. Journal of Instruction and Evaluation, 14(1): 7-38. [In Persian].

Spooren, P., & Christiaens, W. (2017). I liked your course because I believe in (the power of) student evaluations of teaching (SET). Students’ perceptions of a teaching evaluation process and their relationships with SET scores. Studies in Educational Evaluation, 54: 43-49.

Uttl, B., White, C. A., & Gonzalez, D. W. (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54: 22-42.

Wilson, Mark. (2019). Emerging Issues in Classroom Assessment. In: Susan Brookhart & James McMillan (Editors): Classroom Assessment and Educational Measurement. New York: Routledge.

Yarmohammadzadeh, P., Feyzi, A., Mohamadian, K., & Aghatabay, A. (2017). Investigating the Relationship among University Teachersʼ personality Traits, Classroom Leadership Style, and Efficacy through Self-Evaluation: Providing a Structural Model. Journal of Instruction and Evaluation, 10(39): 29-51 [In Persian].

Yorke, Mantz. (2008). Grading Student Achievement in Higher Education: Signals and Shortcomings. London: Routledge.

Ziaee, M., Miri, M., Shima. Hajiabadi, M., Azarkar, S., & Ashik, p. (2008). ZiaSurveying Birjand faculty members’, paramedical and nursing students' viewpoints on educational evaluation plan. Journal of Instruction and Evaluation, 13(4): 9-15 [In Persian].