Diseño y validación de un instrumento para evaluar la calidad de las apps gamificadas que promueven hábitos saludables en el alumnado de educación primaria y secundaria
- Delgado-Morales, Claudio 1
- Duarte-Hueros, Ana 1
- Merino-Godoy, María de los Ángeles 1
- Conde-Vélez, Sara 1
-
1
Universidad de Huelva
info
ISSN: 1578-7680
Year of publication: 2025
Issue Title: Ordinary
Volume: 25
Issue: 81
Type: Article
More publications in: RED: revista de educación a distancia
Abstract
The promotion of health in early ages through gamified technology has emerged in recent years as an innovative strategy with great educational potential to improve specific areas of healthy habits such as hygiene, nutrition, physical activity, or digital education, among others, requiring the involvement of all environments surrounding children and adolescents, especially the family context, in order to achieve overall well-being. Specifically, mobile applications (apps) that incorporate health-related content and target children and adolescents are notable. However, the vast majority lack scientific support based on expert knowledge. This study aims to create a robust and reliable instrument for families to assess the quality of this kind of software, ensuring its educational and safe use. The instrument consists of a questionnaire with 39 items organized into six dimensions. Following a pilot test with 33 families, the results of the statistical analyses conducted have revealed highly favorable psychometric properties, suggesting the utility of the instrument in supporting families in selecting such educational apps.
Bibliographic References
- Albrecht, U., Hillebrand, U. y von Jan, U. (2018). Relevance of Trust Marks and CE Labels in German-Language Store Descriptions of Health Apps: Analysis. JMIR Mhealth Uhealth, 6(4), e10394. https://doi.org/10.2196/10394
- Alexandrou, C., Henriksson, H., Henström, M., Henriksson, P., Nyström, C. D., Bendtsen, M. y Löf, M. (2023). Effectiveness of a Smartphone App (MINISTOP 2.0) integrated in primary child health care to promote healthy diet and physical activity behaviors and prevent obesity in preschool-aged children: randomized controlled trial. International Journal of Behavioral Nutrition and Physical Activity, 20(22). https://doi.org/10.1186/s12966-023-01405-5
- Bardus, M., Awada, N., Ghandour, L. A., Fares, E., Gherbal, T., Al-Zanati, T. y Stoyanov, S. R. (2020). The Arabic Version of the Mobile App Rating Scale: Development and Validation Study. JMIR Mhealth Uhealth, 8(3), e16965. https://doi.org/10.2196/16956
- Baumel, A., Mathur, N., Kane, J. M. y Muench, F. (2017). Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions. Journal of Medical Internet Research, 19(3), e82. https://doi.org/10.2196/jmir.7270
- Böhme, C., von Osthoff, M. B., Frey, K. y Hübner, J. (2019). Development of a Rating Tool for Mobile Cancer Apps: Information Analysis and Formal and Content-Related Evaluation of Selected Cancer Apps. Journal of Cancer Education, 34(1), 105-110. https://doi.org/10.1007/s13187-017-1273-9
- Brown, J. M., Franco-Arellano, B., Froome, H., Siddiqi, A., Mahmood, A. y Arcand, J. (2022). The Content, Quality, and Behavior Change Techniques in Nutrition-Themed Mobile Apps for Children in Canada: App Review and Evaluation Study. JMIR Mhealth Uhealth, 10(2), e31537. https://doi.org/10.2196/31537
- Brown, J. M., Savaglio, R., Watson, G., Kaplansky, A., LeSage, A., Hughes, J., Kapralos, B. y Arcand, J. (2020). Optimizing Child Nutrition Education With the Foodbot Factory Mobile Health App: Formative Evaluation and Analysis. JMIR Formative Research, 4(4), e15534. https://doi.org/10.2196/15534
- Byrne, B. M. (2010). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. (2nd ed.). Routledge.
- Campos, L. F., Cavalcante, J. P., Machado, D. P., Marçal, E., Silva, P. G. y Rolim, J. P. (2019). Development and evaluation of a mobile oral health application for preschoolers. Telemedicine and e-Health, 25(6), 492-498. https://doi.org/10.1089/tmj.2018.0034
- Chan, A., Kow, R. y Cheng, J. K. (2017). Adolescents' perceptions on smartphone applications (apps) for health management. Journal of Mobile Technology in Medicine, 6(2), 47-55. http://dx.doi.org/10.7309/jmtm.6.2.6
- Cheng, H., Tutt, A., Llewellyn, C., Size, D., Jones, J., Taki, S., Rossiter, C. y Denney-Wilson, E. (2020). Content and quality of infant feeding smartphone apps: five-year update on a systematic search and evaluation. JMIR Mhealth Uhealth, 8(5), e17300. http://dx.doi.org/10.2196/17300
- Delgado-Fernández, M. y Tercedor-Sánchez, P. (2021). Estrategias de intervención en educación para la salud desde la Educación Física. INDE.
- Delgado-Morales, C. y Duarte-Hueros, A. (16-18 Noviembre, 2022). Hacia un marco de evaluación de la gamificación en Apps que promueven hábitos saludables en jóvenes [comunicación]. XXV Congreso Internacional Educación y Tecnología EDUTEC 2022, Palma, España. https://bit.ly/3PY8Yy1
- Delgado-Morales, C. y Duarte-Hueros, A. (2023). Revisión sistemática de instrumentos que evalúan la calidad de aplicaciones móviles de salud. Pixel-Bit. Revista De Medios Y Educación, (67), 35-58. https://doi.org/10.12795/pixelbit.97867
- Domnich, A., Arata, L., Amicizia, D., Signori, A., Patrick, B., Stoyanov, S. R., Hides, L., Gasparini, R. y Panatto, D. (2016). Development and validation of the Italian version of the Mobile Application Rating Scale and its generalisability to apps targeting primary prevention. BMC Medical Informatics and Decision Making, 16(83). https://doi.org/10.1186/s12911-016-0323-2
- Expósito-López, J., Romero-Díaz de la Guardia, J. J. y Olmedo-Moreno, E. M. (2023). Diseño y validación de contenido de una rúbrica para medir el valor educativo de aplicaciones para dispositivos móviles. Revista de Educación a Distancia, 23(72). https://doi.org/10.6018/red.54226
- Frontini, R., Sousa, P., Dixe, M. A., Ferreira, R. y Figueiredo, M. C. (2020). Designing a mobile app to promote healthy behaviors and prevent obesity: analysis of adolescents’ preferences. Informatics for Health and Social Care, 45(3), 327-341. https://doi.org/10.1080/17538157.2020.1725766
- Fuemmeler, B. F., Holzwarth, E., Sheng, Y., Do, E. K., Miller, C. A., Blatt, J., Rosoff, P. M. y Østbye, T. (2020). Mila blooms: a mobile phone application and behavioral intervention for promoting physical activity and a healthy diet among adolescent survivors of childhood cancer. Games for Health Journal, 9(4), 279-289. https://doi.org/10.1089/g4h.2019.0060
- González-Calatayud, V., Prendes-Espinosa, M. P. y Solano-Fernández, I. M. (2022). Instrumento de análisis de la competencia de emprendimiento digital en educación superior. RELIEVE - Revista Electrónica De Investigación Y Evaluación Educativa, 28(1). https://doi.org/10.30827/relieve.v28i1.22831
- Hernández-Sampieri, R. y Mendoza-Torres, C. P. (2018). Metodología de la investigación: las rutas cuantitativa, cualitativa y mixta. McGraw Hill Education.
- Hernández-Sampieri, R., Fernández-Collado, C. y Baptista-Lucio, P. (2006). Metodología de la investigación. (4.ª ed.). McGraw-Hill Interamericana.
- Hu, L. y Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternative. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
- Jamaludin, N. F., Tengku-Wook, T. S., Mat-Noor, S. F. y Qamar, F. (2021). Gamification Design Elements to Enhance Adolescent Motivation in Diagnosing Depression. International Journal of Interactive Mobile Technologies, 15(10), 154–172. https://doi.org/10.3991/ijim.v15i10.21137
- Jeminiwa, R. N., Hohmann, N. S. y Fox, B. I. (2019). Developing a Theoretical Framework for Evaluating the Quality of mHealth Apps for Adolescent Users: A Systematic Review. The Journal of Pediatric Pharmacology and Therapeutics, 24(4), 254-269. https://doi.org/10.5863/1551-6776-24.4.254
- Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141-151. https://doi.org/10.1177/001316446002000116
- Kim, S., Park, Y. y Ackerman, M. K. (2021). Designing an Indoor Air Quality Monitoring App for Asthma Management in Children: User-Centered Design Approach. JMIR Formative Research, 5(9), e27447. https://doi.org/10.2196/27447
- Kline, R. B. (2005). Principles and Practice of Structural Equation Modeling. (2nd ed.). Guilford Press.
- Kline, R. B. (2010). Principles and Practice of Structural Equation Modeling. (3rd ed.). Guilford Press.
- Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-386.
- Martín-Fernández, A., Marco-Cuenca, G. y Salvador-Oliván, J. A. (2020). Evaluación y acreditación de las aplicaciones móviles relacionadas con la salud. Revista Española de Salud Pública, 94, e202008085.
- Martín-Payo, R., Fernández-Álvarez, M. M., Blanco-Díaz, M., Cuesta-Izquierdo, M., Stoyanov, S. R. y Llaneza-Suárez, E. (2019). Spanish adaptation and validation of the Mobile Application Rating Scale questionnaire. International Journal of Medical Informatics, 129, 95-99. https://doi.org/10.1016/j.ijmedinf.2019.06.005
- Martin, A., Caon, M., Adorni, F., Andreoni, G., Ascolese, A., Atkinson, S., Bul, K., Carrion, C., Castell, C., Ciociola, V., Condon, L., Espallargues, M., Hanley, J., Jesuthasan, N., Lafortuna, C. L., Lang, A., Prinelli, F., Puidomenech-Puig, E., Tabozzi, S. A. y McKinstry, B. (2020). A Mobile Phone Intervention to Improve Obesity-Related Health Behaviors of Adolescents Across Europe: Iterative Co-Design and Feasibility Study
- JMIR Mhealth Uhealth, 8(3), e14118. https://doi.org/10.2196/14118
- McMillan, J. H. y Schumacher, S. (2005). Investigación educativa. Una introducción conceptual. (5.ª ed.). Pearson Educación.
- Mehta, P., Moore, S. L., Bull, S. y Kwan, B. M. (2021). Building MedVenture – A mobile health application to improve adolescent medication adherence – Using a multidisciplinary approach and academic-industry collaboration. Digital Health, 7. https://doi.org/10.1177%2F20552076211019877
- Messner, E., Terhorst, Y., Barke, A., Baumeister, H., Stoyanov, S. R, Hides, L., Kavanagh, D. J., Pryss, R., Sander, L. y Probst, T. (2020). The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study. JMIR Mhealth Uhealth, 8(3), e14479. https://doi.org/10.2196/14479
- Nunnally, J. y Bernstein, Y. (1995). Teoría psicométrica. McGrawHill.
- Organización Mundial de la Salud. (2004). 57.ª Asamblea Mundial de la Salud. https://bit.ly/3AhCOWS
- Organización Mundial de la Salud. (2011). mHealth: new horizons for health through mobile technologies: second global survey on eHealth. Global Observatory for eHealth. https://bit.ly/3LV8iVu
- Polit, D. F., Beck, C. T. y Owen, S. V. (2007). Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations. Research in Nursing & Health, 30(4), 459-467. https://doi.org/10.1002/nur.20199
- Ramos-Gordillo, A. S. (2003). Actividad Física e Higiene para la Salud. Servicio de publicaciones y producción de la Universidad de Las Palmas de Gran Canaria.
- Razali, N. M. y Wah, Y. B. (2011). Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. Journal of Statistical Modeling and Analytics, 2(1), 21-33.
- Romero-Martínez, S. J. y Ordóñez-Camacho, X. G. (2015). Psicometría. Centro de Estudios Financieros.
- Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S. y Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94-104. https://doi.org/10.1093/swr/27.2.94
- Salas-Cabrera, J. (2015). Estilos de vida saludables: un derecho fundamental en la vida del ser humano. Revista Latinoamericana de Derechos Humanos, 26(2), 37-51. https://doi.org/10.15359/rldh.26-2.2
- Saliasi, I., Martinon, P., Darlington, E., Smentek, C., Tardivo, D., Bourgeois, D., Dussart, C., Carrouel, F. y Fraticelli, L. (2021). Promoting Health via mHealth Applications Using a French Version of the Mobile App Rating Scale: Adaptation and Validation Study. JMIR Mhealth Uhealth, 9(8), e30480. https://doi.org/10.2196/30480
- Sánchez-Álvarez, P. (Coord.). (2007). Desarrollad hábitos de vida saludables. Editorial Azarbe.
- Schmidt, M., Fisher, A. P., Sensenbaugh, J., Ling, B., Rietta, C., Babcock, L., Kurowski, B. G. y Wade, S. L. (2020). User experience (re) design and evaluation of a self-guided, mobile health app for adolescents with mild traumatic brain injury. Journal of Formative Design in Learning, 4(2), 51-64. https://doi.org/10.1007/s41686-019-00038-x
- Sousa, P., Martinho, R., Reis, C. I., Dias, S. S., Gaspar, P. J., Dixe, M. A., Luis, L. S. y Ferreira, R. (2020). Controlled trial of an mHealth intervention to promote healthy behaviours in adolescence (TeenPower): Effectiveness analysis. Journal of Advanced Nursing, 76(4), 1057-1068. https://doi.org/10.1111/jan.14301
- Stoyanov, S. R., Hides, L., Kavanagh, D. J. y Wilson, H. (2016). Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth, 4(2), e72. https://doi.org/10.2196/mhealth.5849
- Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D. y Mani, M. (2015). Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps. JMIR Mhealth Uhealth, 3(1), e27. https://doi.org/10.2196/mhealth.3422
- Terhorst, Y., Philippi, P., Sander, L. B., Schultchen, D., Paganini, S., Bardus, M., Santo, K., Knitza, J., Machado, G. C., Schoeppe, S., Bauereiß, N., Portenhauser, A., Domhardt, M., Walter, B., Krusche, M., Baumeister, H. y Messner, E. M. (2020). Validation of the Mobile Application Rating Scale (MARS). PLoS ONE 15(11), e0241480. https://doi.org/10.1371/journal.pone.0241480
- Thornton, L., Gardner, L. A., Osman, B., Green, O., Champion, K. E., Bryant, Z., Teesson, M., Kay-Lambkin, F. y Chapman, C. (2021). A Multiple Health Behavior Change, Self-Monitoring Mobile App for Adolescents: Development and Usability Study of the Health4Life App. JMIR Formative Research, 5(4), e25513. https://doi.org/10.2196/25513
- Zahid, T., Alyafi, R., Bantanl, N., Alzahrani, R. y Elfirt, E. (2020). Comparison of Effectiveness of Mobile App versus Conventional Educational Lectures on Oral Hygiene Knowledge and Behavior of High School Students in Saudi Arabia. Patient Prefererence and Adherence, 14, 1901-1909. https://doi.org/10.2147/PPA.S270215
- Zichermann, G. y Cunningham, C. (2011). Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. O′Reilly.