Using the student voice to enhance the teaching of undergraduate courses with high failure rates
Keywords:student evaluation questionnaires, student voice, failure rates
AbstractWhilst it is likely that some students will fail a course, it is important for universities to determine whether such failure is a personal outcome or whether there are aspects of the course that could be more conducive to student learning. In adopting a student-centred approach, this research analysed data drawn from student evaluation questionnaires (SEQs) in order to establish how students thought the teaching of undergraduate courses with high failure rates could be improved. Many higher education institutions use SEQs as tools for gathering data on the teaching and learning experience, but the emphasis here is on how such data can be used. Content analysis was used to map the SEQs of students enrolled on 19 courses with high failure rates against a baseline developed from the SEQs of students enrolled on 19 courses with low failure rates. This paper examines these responses and makes five recommendations specifically aimed at improving undergraduate courses with high failure rates.
Bedard, K. and Kuhn, P. (2008) 'Where class size really matters: Class size and student ratings of instructor effectiveness'. Economics of Education Review. 27 (3): 253-265.
Beran, T. (2005) 'Ratings of university teacher instruction: how much do student and course characteristics really matter?'. Assessment & Evaluation in Higher Education. 30 (6): 593-601.
Bornholt, L., and Möller, J. (2003) 'Attributions about achievement and intentions about further study in social context'. Social Psychology of Education. 6 (3): 217–231.
Chamorro-Premuzic, T. & Furnham, A. (2005). Personality and intellectual competence. Mahwah, NJ: Lawrence Erlbaum.
Chanock, K. (2007) 'What academic language and learning advisors bring to the scholarship of teaching and learning: Problems and possibilities for dialogue with the disciplines'. Higher Education Research & Development. 26 (3): 269-280.
Clayson, D. E. (2009) 'Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature'. Journal of Marketing Education. 31 (1): 16-30.
Clayson, D. E., and Haley, D. A. (2011) 'Are Students Telling Us the Truth? A Critical Look at the Student Evaluation of Teaching'. Marketing Education Review. 21 (2): 101-112.
Cook-Sather, A. (2006) 'Sound, Presence, and Power: Exploring "Student Voice" in Educational Research and Reform'. Curriculum Inquiry. 36 (4): 359-390.
Emery, C. R., Kramer, T. R., and Tian, R. G. (2003) 'Return to academic standards: a critique of student evaluations of teaching effectiveness'. Quality Assurance in Education. 11 (1): 37-46.
Forsyth, D., Story, P., Kelley, K., and McMillan, J. (2009) 'What causes failure and success? Students' perceptions of their academic outcomes'. Social Psychology of Education. 12 (2): 157-174. http://dx.doi.org/10.1007/s11218-008-9078-7
Foster, G. (2010) 'Teacher effects on student attrition and performance in mass-market tertiary education'. Higher Education. 60 (3): 301-319. http://dx.doi.org/10.1007/s10734-009-9301-2
Freeman, H. R. (1994) 'Student evaluations of college instructors: Effects of type of course taught, instructor gender and gender role, and student gender'. Journal of Educational Psychology. 86 (4): 627-630. http://dx.doi.org/10.1037/0022-0618.104.22.1687
Giorgi, A. (1994). 'A phenomenological perspective on certain qualitative research methods'. Journal of Phenomenological Psychology. 25 (2): 190-220. http://dx.doi.org/10.1163/156916294X00034
Good, T. and Brophy, J. (2003) Looking in Classrooms. Ninth Edition. New York: Macmillan.
Greenwald, A. G. (2002) Constructs in Student Ratings of Instructors. In Braun, H. I., Jackson, D. N. and Wiley, D. E. (eds) The Role of Constructs in Psychological and Educational Measurement. New York: Erlbaum.
Haynes Stewart, T. L, Clifton, R. A., Daniels, L. M., Perry, R. P., Chipperfield, J. G. and Ruthig, J. C. (2011) 'Attributional retraining: reducing the likelihood of failure'. Journal of Social and Clinical Psychology. 14 (1): 75-92.
Hellman, C. M. (1998) 'Faculty evaluation by students: a comparison between full-time and adjunct faculty'. Journal of Applied Research in the Community College. 6 (1): 45-50.
Kember, D. (1997) 'A reconceptualization of the research into university academics' conceptions of teaching'. Learning Instruction. 7 (3): 255-275.
Kember, D. (2000) 'Misconceptions about the learning approaches: Motivation and study practices of Asian students'. Higher Education. 40 (1): 99-121.
Kerlinger, F. N. (1970) Foundations of Behavioural Research. New York: Holt, Rinehart and Winston.
Kotze, T. G. and Du Plessis, P. J. (2003) 'Students as co producers of education: A proposed model of students' socialization and participation at tertiary institutions'. Quality Assurance in Education. 27 (1): 27-52.
Layne, B. H., DeCristoforo, J. R. and McGinty, D. (1999). 'Electronic Versus Traditional Student Ratings of Instruction'. Research in Higher Education. 40 (2): 221-232.
Ling, J., Heffernan, T. M. and Muncer, S. J. (2003) 'Higher education students' beliefs about the causes of examination failure: A network approach'. Social Psychology of Education. 6 (2): 159-170. http://dx.doi.org/10.1023/A:1023289908438
Ling, F. Y. Y, Ng, P. K. and Leung, M-Y. (2011) 'Predicting the academic performance of construction engineering students by teaching and learning approaches: case study'. Journal of Professional Issues in Engineering Education & Practice. 137 (4): 277-284.
Lizzio, A., Wilson, K. and Simons, R. (2002) 'University students' perceptions of the learning environment and academic outcomes: implications for theory and practice'. Studies in Higher Education. 27 (1): 27-52. http://dx.doi.org/10.1080/03075070120099359
Magnusson, J. L. (1998) The Evaluation of University Teaching: Exploring the Question of Resistance. Ontario Institute of Education: University of Toronto.
Margaret, B. and Guest, R. (2007) 'A conversation about pedagogical responses to increase diversity in university classrooms'. Higher Education Research & Development. 26 (2): 133-146.
Marsh, H. W. (1984) 'Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility'. Journal of Educational Psychology. 76 (5): 707-754.
Marsh, H.W. (1987) 'Students evaluations of university teaching: Research findings, methodological issues, and directions for future research'. International Journal of Educational Research. 11 (3): 253-388. http://dx.doi.org/10.1016/0883-0355(87)90001-2
Marsh, H. W. and Bailey, M. (1993) 'Multidimensional students' evaluations of teaching effectiveness: a profile analysis'. Journal of Higher Education. 64 (1): 1-18.
McKeachie, W. J., Pintrich, P. R, Yi-Guang, L. and Smith, D. A. F. (1986) Teaching and Learning in the College Classroom: A Review of the Research Literature. MI: The University of Michigan.
McPherson, M., Jewell, R. and Kim, M. (2009) 'What Determines Student Evaluation Scores? A Random Effects Analysis of Undergraduate Economics Classes'. Eastern Economic Journal. 35 (1): 37-51. http://dx.doi.org/10.1057/palgrave.eej.9050042
Miles, M. B. and Huberman, M. (1994) Qualitative Data Analysis: An Expanded Sourcebook. Thousand Oaks, CA: Sage.
Mortenson, S. (2006) 'Cultural Differences and Similarities in Seeking Social Support as a Response to Academic Failure: A Comparison of American and Chinese College Students'. Communication Education. 55 (2): 127-146. http://dx.doi.org/10.1080/03634520600565811
Patrick, C. L. (2011) 'Student evaluations of teaching: effects of the Big Five personality traits, grades and the validity hypothesis'. Assessment & Evaluation in Higher Education. 36 (2): 239-249. http://dx.doi.org/10.1080/02602930903308258
Peelo, M. (2002) Setting the Scene. In Peelo, M. and Wareham, T. (eds) Failing Students in Higher Education. Buckingham: Open University Press.
Piccinin, S., Cristi, C. and McCoy, M. (1999) 'The impact of individual consultation on student ratings of teaching'. International Journal for Academic Development. 4 (2): 75-88.
Reneland, L. and Ahlbäck, T. (2003) Quality interaction, collaboration and web-based learning: A study of a teacher training. Proceedings of the annual HERDSA conference, July 3-6, 2003, Christchurch, New Zealand.
Richardson, J., Slater, J. and Wilson, J. (2007) 'The national student survey: Development, findings and implications'. Studies in Higher Education. 32 (5): 557-580.
Rodgers, J. R. (2002) 'Encouraging tutorial attendance at university did not improve performance'. Australian Economic Papers. 41 (3): 255-266.
Seale, J. (2009) 'Doing student voice work in higher education: an exploration of the value of participatory methods'. British Educational Research Journal. 36 (6): 995-1015.
Spencer, K. J and Schmelkin, L. P. (2002) 'Student perspectives on teaching and its evaluation'. Assessment & Evaluation in Higher Education. 27 (50): 397-409.
Struthers, C. W., Menec, V. H., Schonwetter, D. J. and Perry, R. P. (1996) 'The effects of perceived attributions, action control, and creativity on college students' motivation and performance: A field study'. Learning and Individual Differences. 8 (2): 121-139.
Thielens, W. Jr. (1987) The disciplines and undergraduate lecturing. Paper presented at the annual meeting of the American Educational Research Association, 20-24th April. Washington, DC.
Tucker, B., Jones, S. and Staker, L. (2008) 'Online student evaluation improves course experience questionnaire: results in a physiotherapy program'. Higher Education Research and Development. 27 (3): 281-96. http://dx.doi.org/10.1080/07294360802259067
Turner, J., Husman, J. and Schallert, D. (2002).' The Importance of Students' Goals in Their Emotional Experience of Academic Failure: Investigating the Precursors and Consequences of Shame'. Educational Psychologist. 37 (2): 79-89. http://dx.doi.org/10.1207/S15326985EP3702_3
Weiner, B. (1995) Judgements of Responsibility: A Foundation for a Theory of Social Conduct. Guildford Press: New York, NY.
Weinberg, B. A., Hashimoto, M. and Fleisher, B. M. (2009) 'Evaluating Teaching in Higher Education'. Journal of Economic Education. 40 (3): 227-261.
Wimshurst, K. and Allard, T. (2008) 'Personal and institutional characteristics of student failure'. Assessment & Evaluation in Higher Education. 33 (6): 687-698.
Wongsurawat, W. (2011) 'What's a comment worth? How to better understand student evaluations of teaching'. Quality Assurance in Education. 19 (1): 67-83.