Adapting to the European Higher Education Area a questionnaire on student opinion about the teaching of lecturers

Authors

  • José Francisco Lukas University of the Basque Country
  • Karlos Santiago University of the Basque Country
  • Juan Etxeberria University of the Basque Country
  • Luis Lizasoain University of the Basque Country

DOI:

https://doi.org/10.7203/relieve.20.1.3812

Keywords:

Teacher evaluation, European Higher Education Area, survey validation, reliability, validity, mixed methods

Abstract

After reviewing questionnaires from other universities, taking into account the theoretical framework of the new questionnaire, the transversal skills adopted by the University and the three dimensions set out by ANECA, a series of indicators and possible items deemed suitable to be included in the new questionnaire were drawn up. This results were all compared and contrasted within various focus groups undertaken with experts in the topic, with lecturers, and with students. Based on this comparison, the pilot questionnaire, which had 18 items plus two more criterion-referenced items, was drawn up. This was applied to a sample of almost one thousand students. The analyses carried out to  the items, as well as the reliability and the validity of the test, show that the questionnaire rigorously complies with the standards required by this type of instrument. Finally, in the discussion of the results, certain controversial aspects, or those relating to improving the evaluation of the university teaching staff, are presented.  Indicated amongst these aspects, is the need to incorporate the questionnaire into a more wider-ranging evaluation plan, such as DOCENTIA, the possibility of creating banks of items, the inclusion of open items and the exigency of undertaking on-line applications of the questionnaire.

Author Biographies

José Francisco Lukas, University of the Basque Country

PhD in Pedagogy, a graduate in Philosophy and Educational Sciences (Pedagogy section) and a qualified teacher. Tenured lecturer in Educational Evaluation at the Department of Educational Research and Diagnostic Methods at the University of the Basque Country (UPV-EHU), he graduate and masters’ degree courses in Human and Social Sciences and is a specialist in Evaluation in Education with special dedication given over to topics regarding the evaluation of educational programmes and centres and the construction of measuring instruments. He is section editor in RELIEVE

Karlos Santiago, University of the Basque Country

PhD in Pedagogy, a graduate in Philosophy and Educational Sciences (Pedagogy section) and a qualified teacher. Tenured lecturer in Research Methods at the Department of Educational Research and Diagnostic Methods at the UPV-EHU, he teaches graduate and masters’ degree courses in Human and Social Sciences and is a specialist in Research Methods in Education with special dedication to research linked to academic performance and the evaluation of socio-educational programmes

Juan Etxeberria, University of the Basque Country

PhD in Educational Sciences and a graduate in Exact Sciences (specialising in statistics). Tenured lecturer in Statistics at the Department of Research and Diagnostic Methods in Education of the UPV-EHU at its Donostia-San Sebastián campus.

Luis Lizasoain, University of the Basque Country

PhD in Philosophy and Educational Sciences. Tenured lecturer in Statistics at the Department of Research and Diagnostic Methods in Education of the UPV-EHU at its Donostia-San Sebastián campus, he teaches graduate and masters’ degree course in Human and Social Sciences, both at the UPV-EHU and in various Latin American universities

References

ANECA (2006). DOCENTIA (Programa de apoyo para la evaluación de la actividad docente del profesorado universitario). Modelo de evaluación. Recuperado de http://www.aneca.es/var/media/215769/docentia_modelo_070302.pdf

Apodaca, P. & Grad, H. (2002). Análisis dimensional de las opiniones de los alumnos universitarios sobre sus profesores: comparación entre técnicas paramétricas y no paramétricas. Revista de Investigación Educativa, 20(2), 385-409.

Berk, R. A. (2013). Should Global on Student Rating Scales Bi Used for Summative Decisions?. Journal of Faculty Development, 27(1), 63-67.

Bol-Arreba, A., Sáiz-Manzanares, M.C. & Pérez-Mateos, M. (2013). Validación de una encuesta sobre la actividad docente en Educación Superior. Aula Abierta, 41(2), 45-54.

Casero Martínez, C. (2008). Propuesta de un cuestionario de evaluación de la calidad docente universitaria consensuado entre alumnos y profesores. Revista de Investigación Educativa, 26(1) 25-44.

Creswell, J.W. & Plano, V.L. (2011). Designing and conducting Mixed Methods Research. London: SAGE.

De la Fuente, J., Martínez, J.M., Peralta, F.J. & García, A.B. (2010). Percepción del proceso de enseñanza-aprendizaje y rendimiento académico en diferentes contextos instruccionales de la Educación Superior. Psicothema, 22(4), 806-812.

Gómez-Gallego, J.C., Gómez-Gallego, M., Pérez-Cárceles, M.C., Palazón-Pérez de los Cobos, A. & Gómez-García, J. (2013). Interacción entre las expectativas académicas del alumno y la evaluación del profesorado. Aula Abierta 2013, 41(2), 35-44.

Lukas, J.F. & Santiago, K. (2009). Evaluación educativa. Madrid: Alianza.

Marsh, H. W. (1987). Students’ evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11, 253-288.

Molero, D. & Ruiz, J. (2005). La evaluación de la docencia universitaria. Dimensiones y variables más relevantes. Revista de Investigación Educativa, 23(1), 57-84.

Muñiz, J. (2005). La validación de los tests. Metodología de las ciencias del comportamiento, 5, 121-141.

Muñoz Cantero, J.M., Ríos de Deus, M.P. & Abalde, E. (2002). Evaluación docente vs. Evaluación de la calidad. Revista Electrónica de Investigación y Evaluación Educativa, 8(2). Recuperado de http://www.uv.es/RELIEVE/v8n2/RELIEVEv8n2_4.pdf

Palazón, A. (2011). Evaluación de la docencia y del aprendizaje en el marco del Espacio Europeo de Educación Superior. Tesis doctoral inédita. Universidad Católica San Antonio de Murcia. Recuperado de http://repositorio.ucam.edu/jspui/bitstream/10952/139/1/Tesis Doctoral pdf.pdf

Ruiz Carrascosa, J. (2005). La evaluación de la docencia en los planes de mejora de la universidad. Educación XXI, 8, 87-102.

Tejedor, F.J. (2003). Un modelo de evaluación del profesorado universitario. Revista de Investigación Educativa, 21(1), 157-182.

Tejedor, F.J. (2009). Evaluación del profesorado universitario: enfoque metodológico y algunas aportaciones de la investigación. Estudios sobre Educación, 16, 79-102.

Worthington, A. (2002). The impact of student perceptions and characteristics on teaching evaluations: a case study in finance education. Assessment and Evaluation in Higher Education, 27(1), 49-64. doi: 10.1080/02602930120105054

Downloads

Published

2014-07-03

Issue

Vol. 20 No. 1 (2014)

Section

Research Articles

License

The authors grant non-exclusive rights of exploitation of works published to RELIEVE and consent to be distributed under the Creative Commons Attribution-Noncommercial Use 4.0 International License (CC-BY-NC 4.0), which allows third parties to use the published material whenever the authorship of the work and the source of publication is mentioned, and it is used for non-commercial purposes. 

    The authors can reach other additional and independent contractual agreements, for the non-exclusive distribution of the version of the work published in this journal (for example, by including it in an institutional repository or publishing it in a book), as long as it is clearly stated that the Original source of publication is this magazine.  

    Authors are encouraged to disseminate their work after it has been published, through the internet (for example, in institutional archives online or on its website) which can generate interesting exchanges and increase work appointments. 

   The fact of sending your paper to RELIEVE implies that you accept these conditions.