Desarrollo y validación de una herramienta de Observación del Clima Emocional (OCE)Observación del Clima Emocional (OCE) generado por los docentes

  1. FIERRO-SUERO, Sebastián 1
  2. Sáenz-López, Pedro 1
  3. Velázquez-Ahumada, Natalia 1
  4. De las Hera-Pérez, M. Ángeles 1
  5. Almagro, Bartolomé J. 1
  6. Bisquerra, Rafael 2
  1. 1 Universidad de Huelva
    info

    Universidad de Huelva

    Huelva, España

    ROR https://ror.org/03a1kt624

  2. 2 Universitat de Barcelona
    info

    Universitat de Barcelona

    Barcelona, España

    ROR https://ror.org/021018s57

Journal:
Profesorado: Revista de curriculum y formación del profesorado

ISSN: 1989-6395 1138-414X

Year of publication: 2024

Issue Title: Miscelánea

Volume: 28

Issue: 1

Pages: 77-100

Type: Article

DOI: 10.30827/PROFESORADO.V28I1.27947 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Profesorado: Revista de curriculum y formación del profesorado

Abstract

This work presents the process of creation (study 1) and validation (study 2) of an instrument of "Emotional Climate Observation (OCE)". In study 1, a Delphi method was carried out in 3 rounds, in which 12 experts on the subject participated. As a result, the OCE emerged, composed of 6 main dimensions and 2 observable aspects in each dimension. The resulting dimensions relate to didactic aspects and aspects related to teachers' emotional competences. In study 2, with the data collected from the 10 observations made by three observers, the psychometric properties of the OCE were analyzed through the Generalizability Theory (GT) and the intraclass and Kappa correlation coefficients. The results obtained show that the OCE is a valid, reliable and useful tool to determine the degree to which the teacher generates a positive, neutral or negative emotional climate, and can be used in educational research or training.      

Bibliographic References

  • Alonso-Tapia, J., & Nieto, C. (2019). Classroom emotional climate: nature, measurement, effects and implications for education// Clima emocional de clase: naturaleza, medida, efectos e implicaciones para la educación. Revista de Psicodidactica, 24(2), 79-87. https://doi.org/10.1016/j.psicod.2018.08.002
  • Andrés-García, I., Muñoz-Moreno, F., Ruíz-López del Prado, G., Gil-Sáez, B., Andrés Puertas, M., & Almaraz-Gómez, A. (2019). Validación de un cuestionario sobre actitudes y práctica de actividad física y otros hábitos saludables mediante el método Delphi. Revista Española Salud Pública, 93, e201909081.
  • Anguera, M. T. (2003). La observación. En C. M. Rosset (Ed.), Evaluación psicológica. Concepto, proceso y aplicación en las áreas del desarrollo y de la inteligencia (pp. 271-308). Sanz & Torres. https://doi.org/10.1016/j.psicod.2018.08.002
  • Anguera, M. T., Camerino, O., Castañer, M., Sánchez-Algarra, P., & Onwuegbuzie, A. (2017). The specificity of observational studies in physical activity and sports sciences: Moving forward in mixed methods research and proposals for achieving quantitative and qualitative symmetry. Frontiers in Psychology, 8:2196. https://doi.org/10.3389/fpsyg.2017.02196
  • Bar-On, R. (1997). The Emotional Intelligence Inventory (EQi): Technical manual. Multi-Heal.
  • Barrientos, A., Sánchez, R., & Arigita, A. (2019). Formación emocional del profesorado y gestión del clima de su aula. Praxis & Saber, 10(24), 119-141. https://doi.org/https://doi.org/10.19053/22160159.v10.n25.2019.9894
  • Bieg, S., Grassinger, R., & Dresel, M. (2019). Teacher humor: longitudinal effects on students’ emotions. European Journal of Psychology of Education, 34, 517-534. https://doi.org/https://doi.org/10.1007/s10212-018-0402-0
  • Bisquerra, R. (2020). Emociones. Instrumentos de medición y evaluación. Madrid: Síntesis.
  • Bisquerra, R., & Pérez, N. (2007). Las competencias emocionales. Educación XX1, 10, 61-82. https://doi.org/10.5944/educxx1.1.10.297
  • Blanco-Villaseñor, A. (1991). La teoría de la generalizabilidad aplicada a diseños observacionales. Revista Mexicana de Análisis de la Conducta, 17(3), 23-63.
  • Blanco-Villaseñor, Á., Castellano, J., & Hernández-Mendo, A. (2014). Aplicación de la TG en el deporte para el estudio de la fiabilidad, validez y estimación de la muestra. Revista de Psicología del Deporte, 23(1), 131-137.
  • Brand, S., Felner, R., Shim, M., Seitsinger, A., & Dumas, T. (2003). Middle school improvement and reform: Development and validation of a school-level assessment of climate, cultural pluralism, and school safety. Journal of Educational Psychology, 95(3), 570–588. https://doi.org/10.1037/0022-0663.95.3.570
  • Cerda, J., & Villarroel, L. (2008). Evaluación de la concordancia inter-observador en investigación pediátrica: Coeficiente de Kappa. Revista Chilena de Pediatria, 79(1), 54-58. https://doi.org/10.4067/s0370-41062008000100008
  • Chacón-Moscoso, S., Anguera, M. T., Sanduvete-Chaves, S., Losada, J. L., LozanoLozano, J. A., & Portell, M. (2019). Methodological quality checklist for studies based on observational methodology (MQCOM). Psicothema, 31(4), 458-464. https://doi.org/10.7334/psicothema2019.116
  • Díaz, M. C., Borges, A., Valadez, M. D., & Zambrano, R. (2015). Assessing of good teaching practices through systematic observation. Universitas Psychologica, 14(3), 913-922. https://doi.org/10.11144/Javeriana.upsy14-3.vbpd
  • Escalante-Mateos, N., Fernández-Zabala, A., Goñi-Palacios, E., Fuente-Díaz, I.I. (2020). Una nueva versión de la escala Percepción del Alumnado sobre el Clima Escolar (PACE) y análisis de sus propiedades psicométricas. Revista de Psicología y Educación, 15, 201-221. https:://doi.org/10.23923/rpye2020.02.196
  • Escartí, A., Gutiérrez, M., Pascual, C., & Wright, P. (2013). Observación de las estrategias que emplean los profesores de educación física para enseñar responsabilidad personal y social. Revista de Psicologia del Deporte, 22(1), 159-166.
  • Evans, I. M., Harvey, S. T., Buckley, L., & Yan, E. (2009). Differentiating classroom climate concepts: Academic, management, and emotional environments. Kotuitui, 4(2), 131-146. https://doi.org/10.1080/1177083X.2009.9522449
  • Fabra, P., Balaguer, I., Tomas, I., Smith, N., & Duda, J. (2018). Spanish version of the multidimensional motivational climate observation system (MMCOS): reliability and validity evidences. Revista de Psicología del Deporte/Journal of Sport Psychology, 27(1), 11-22.
  • Fierro-Suero, S., Almagro, B., Castillo, I., & Sáenz-López, P. (2020). Observational instrument for interpersonal motivational climate (OCIM) for physical education teachers. Cultura, Ciencia y Deporte, 15(46), 575-596. https://doi.org/10.12800/ccd.v15i46.1647
  • Fierro-Suero, S., Saénz-López, P., Carmona, J., & Almagro, B. (2023). Achievement emotions, intention to be physically active and academic performance in physical education: Gender differences. Journal of Teaching in Physical Education, 42, 114-122. https://doi.org/10.1123/jtpe.2021-0230
  • Fleiss, J. L., Levin, B., & Paik, M. C. (1982). Statistical Methods for Rates and Proportions (3rd ed). Wiley-Inte. https://doi.org/10.2307/2982107
  • Gazelle, H. (2006). Class climate moderates peer relations and emotional adjustment in children with an early history of anxious solitude: A child × environment model. Developmental Psychology, 42(6), 1179-1192. https://doi.org/10.1037/0012-1649.42.6.1179
  • Goleman, D. (1995). Emotional intelligence. Bantam Boo.
  • Gómez-Leal, R., Holzer, A. A., Bradley, C., Fernández-Berrocal, P., & Patti, J. (2022). The relationship between emotional intelligence and leadership in school leaders: a systematic review. Cambridge Journal of Education, 52(1), 1-21. https://doi.org/10.1080/0305764X.2021.1927987
  • Haerens, L., Aelterman, N., Van den Berghe, L., De Meyer, J., Soenens, B., & Vansteenkiste, M. (2013). Observing physical education teachers’ needsupportive interactions in classroom settings. Journal of Sport and Exercise Psychology, 35, 3-17. https://doi.org/10.1123/jsep.35.1.3
  • Harvey, S. T., Evans, I. M., Hill, R. V. J., Henricksen, A., & Bimler, D. (2016). Warming the emotional climate of the classroom: Can teachers’ socialemotional skills change? .The International Journal of Emotional Education, 8(2), 70-87.
  • Hernández-Mendo, A., Blanco-Villaseñor, A., Pastrana, J. L., Morales-Sánchez, V., & Ramos-Pérez, F. J. (2016). SAGT: Aplicación informática para análisis de generalizabilidad. Revista Iberoamericana de Psicologia del Ejercicio y el Deporte, 11(1), 77-89.
  • Hernández-Mendo, A., Ramos-Pérez, F., & Pastrana, J. (2012). SAGT: Programa informático para análisis de Teoría de la Generalizabilidad (Safe Creative Código: 1204191501059).
  • Hernandez, A., Días, F., & Morales, V. (2010). Construcción de una herramienta observacional para evaluar las conductas prosociales en las clases de educación física. Revista de Psicologia del Deporte, 19(2), 305-318.
  • Jennings, P. A., & Greenberg, M. T. (2009). The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Review of Educational Research, 79(1), 491-525. https://doi.org/10.3102/0034654308325693
  • Jia, Y., Way, N., Ling, G., Yoshikawa, H., Chen, X., Hughes, D., Ke, X., & Lu, Z. (2009). The influence of student perceptions of school climate on socioemotional and academic adjustment: A comparison of chinese and american adolescents. Child Development, 80(5), 1514-1530. https://doi.org/10.1111/j.1467-8624.2009.01348.x
  • Jiménez Morales, M. I., & López-Zafra, E. (2009). Inteligencia emocional y rendimiento escolar: Estado actual de la cuestión. Revista Latinoamericana de Psicologia, 41(1), 69-79.
  • Liu, W., Mei, J., Tian, L., & Huebner, E. S. (2016). Age and gender differences in the relation between school-related social support and subjective well-being in school among students. Social Indicators Research, 125(3), 1065-1083. https://doi.org/10.1007/s11205-015-0873-1
  • Llamas-Díaz, D., Cabello, R., Megías-Robles, A., & Fernández-Berrocal, P. (2022). Systematic review and meta-analysis: The association between emotional intelligence and subjective well-being in adolescents. Journal of Adolescence, 94(7), 925-938. https://doi.org/10.1002/jad.12075
  • López-Gómez, E. (2018). El método delphi en la investigación actual en educación: Una revisión teórica y metodológica. Educacion XX1, 21(1), 17-40. https://doi.org/10.5944/educXX1.15536
  • López-González, L., y Bisquerra, R. (2013). Validación y análisis de una escala breve para evaluar el clima de clase en Educación Secundaria. Psicopedagogía, 5, 62- 77.
  • López-González, L., & Oriol, X. (2016). La relación entre competencia emocional, clima de aula y rendimiento académico en estudiantes de secundaria. Cultura y Educacion, 28(1), 130-156. https://doi.org/10.1080/11356405.2015.1120448
  • López, L., & Bisquerra, R. (2013). Validación y análisis de una escala breve para evaluar el clima de clase en educación secundaria. Psicopedagogía, 62-77.
  • Lucas-Molina, B., Williamson, A. A., Pulido, R., & Pérez-Albéniz, A. (2015). Effects of teacher–student relationships on peer harassment: a multilevel study. Journal of adolescence, 52(3), 298-315. https://doi.org/10.1002/pits
  • Moos, Rudolf y Trickett, Edison. (1974). Classroom environment scale manual. Palo Alto: Consulting Psychologist Press.
  • Páez, D., Ruiz, J., Gailly, O., Kornblit, A., Wiesenfeld, E., & Vidal, C. (1997). Clima emocional: su concepto y medición mediante una investigación transcultural. Revista de Psicología Social, 12(1), 79 98. https://doi.org/10.1174/021347497320892045
  • Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18, 315-341. https://doi.org/10.1007/s10648-006-9029-9
  • Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36, 36-48. https://doi.org/10.1016/j.cedpsych.2010.10.002
  • Pérez, A., Ramos, G., & López, E. (2009). Diseño y análisis de una escala para la valoración de la variable clima social aula en alumnos de educación primaria y secundaria. Revista de Educación, 350, 221-252.
  • Pérez, A., Ramos, G., & López, E. (2010). Clima social aula: percepción diferenciada de los alumnos de educación secundaria obligatoria. Cultura y Educación, 22(3), 259-281. https://doi.org/10.1174/113564010804932184
  • Pérez, J. I. R., Molleda, C. B., Díaz, F. J. R., & Cueto, E. G. (2014). Transcultural validation of an emotional climate scale for prison environments. Revista Latinoamericana de Psicologia, 46(2), 92-101. https://doi.org/10.1016/s0120-0534(14)70012-3
  • Polit, E. F., Beck, T. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30, 459–467.
  • Portell, M., Anguera, M. T., Chacón-Moscoso, S., & Sanduvete-Chaves, S. (2015). Guidelines for reporting evaluations based on observational methodology. Psicothema, 27(3), 283-289. https://doi.org/10.7334/psicothema2014.276
  • Portney, L. G., & Watkins, M. P. (2009). Foundations of Clinical Research: Applications to practice (3rd ed). Pearson ed.
  • Quintana-Orts, C., Mérida-López, S., Rey, L., & Extremera, N. (2021). A closer look at the emotional intelligence construct: How do emotional intelligence facets relate to life satisfaction in students involved in bullying and cyberbullying? European Journal of Investigation in Health, Psychology and Education, 11(3), 711-725. https://doi.org/10.3390/EJIHPE11030051
  • Reeve, J. (2010). Motivation and emotion. McGraw Hill.
  • Reguant-Álvarez, M., Torrado-Fonseca, M., & Fecha. (2016). El método Delphi. REIRE, Revista d’ Innovació i Recerca en Educació, 9(1), 87-102. https://doi.org/10.1344/reire2016.9.1916
  • Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate , student engagement , and academic achievement. Journal of Educational Psychology, 104(3), 700-712. https://doi.org/10.1037/a0027268
  • Rodríguez, G., Juarez, S., Cruz, K., & Flores, A. (2015). Propiedades psicotécnicas de la Escala de Clima Emocional en habitantes del Estado de México. Revista Mejicana de investigación en Psicología, 7(1), 32-40.
  • Rubin, D. B., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. Journal of the American Statistical Association, 69(348), 1050. https://doi.org/10.2307/2286194
  • Rueda, P., Pérez-Romero, N., Cerezo, M. V., & Fernández-Berrocal, P. (2022). The Role of Emotional Intelligence in Adolescent Bullying: A Systematic Review. Psicologia Educativa, 28(1), 53-59. https://doi.org/10.5093/psed2021a29
  • Sáenz-López, P. (2020). Educar Emocionando. Uhu.es publicaciones.
  • Sánchez-Álvarez, N., Berrios Martos, M. P., & Extremera, N. (2020). A Meta-Analysis of the Relationship Between Emotional Intelligence and Academic Performance in Secondary Education: A Multi-Stream Comparison. Frontiers in Psychology, 11(July), 1-11. https://doi.org/10.3389/fpsyg.2020.01517
  • Sánchez-Oliva, D., Pulido-González, J. J., Leo, F. M., González-Ponce, I., & GarcíaCalvo, T. (2017). Effects of an intervention with teachers in the physical education context: A selfdetermination theory approach. PLoS ONE 12(12), e0189986.
  • Smith, N., Tessier, D., Tzioumakis, Y., Quested, E., Appleton, P., Sarrazin, P., Papaioannou, A., & Duda, J. L. (2015). Development and validation of the multidimensional motivational climate observation system. Journal of Sport and Exercise Psychology, 37(1), 4-22. https://doi.org/10.1123/jsep.2014-0059
  • Stone, A. A., & Shiffman, S. (2002). Capturing momentary, self-report data: A proposal for reporting guidelines. Annals of Behavioral Medicine, 24(3), 236-243. https://doi.org/10.1207/S15324796ABM2403_09
  • Torrijos, P., Martín, J. F., & Rodríguez, M. J. (2018). La educación emocional en la formación permanente del profesorado no universitario. Profesorado, Revista De Currículum Y Formación Del Profesorado, 22(1), 579-597. https://doi.org/https://doi.org/10.30827/profesorado.v22i1.9943
  • Trianes, M. V., Blanca, M. J., de la Morena, L., Infante, L., y Raya, S. (2006). Un cuestionario para evaluar el clima social del centro escolar. Psicothema, 18(2), 272-277.
  • Ulloa, M., Evans, I., & Jones, L. (2016). The effects of emotional awareness training on teachers’ ability to manage the emotions of preschool children: An experimental study. Escritos de Psicología, 9(1), 1-14. https://doi.org/10.5231/psy.writ.2015.1711
  • Uztosun, M. S. (2018). Professional competences to teach English at primary schools in Turkeyâ: a Delphi study. European Journal of Teacher Education, 00(00), 1-17. https://doi.org/10.1080/02619768.2018.1472569
  • Valero-Valenzuela, A., Camerino, O., Manzano-Sánchez, D., Prat, Q., & Castañer, M. (2020). Enhancing learner motivation and classroom social climate: A mixed methods approach. International Journal of Environmental Research and Public Health, 17, 5272. https://doi.org/doi:10.3390/ijerph17155272
  • Vizoso-Gómez, C. (2022). Inteligencia emocional y compromiso laboral en el profesorado: revisión de la literatura. Profesorado, Revista De Currículum Y Formación Del Profesorado, 26(3), 395–414. https://doi.org/https://doi.org/10.30827/profesorado.v26i3.21451
  • Wang, M. Te, L. Degol, J., Amemiya, J., Parr, A., & Guo, J. (2020). Classroom climate and children’s academic and psychological wellbeing: A systematic review and meta-analysis. Developmental Review, 57, 100912. https://doi.org/10.1016/j.dr.2020.100912
  • Wyant, J. D., Tsuda, E., & Yeats, J. T. (2020). Delphi investigation of strategies to develop cultural competence in physical education teacher education. Physical Education and Sport Pedagogy, 25(5), 525-538. https://doi.org/10.1080/17408989.2020.1746252
  • Yoder, P., Lloyd, B., & Symons, F. (2018). Observational measurement of behavior (2nd ed). Paul H. Brookes Publishing Co.