Evaluación de la inteligencia artificial generativa en el contexto de la automáticaun análisis crítico

  1. Barragán, Antonio Javier 1
  2. Aquino, Arturo 1
  3. Enrique, Juan Manuel 1
  4. Segura, Francisca 1
  5. Martínez, Miguel Ángel 1
  6. Andújar, José Manuel 1
  1. 1 Universidad de Huelva
    info

    Universidad de Huelva

    Huelva, España

    ROR https://ror.org/03a1kt624

Revista:
Jornadas de Automática
  1. Cruz Martín, Ana María (coord.)
  2. Arévalo Espejo, V. (coord.)
  3. Fernández Lozano, Juan Jesús (coord.)

ISSN: 3045-4093

Any de publicació: 2024

Número: 45

Tipus: Article

DOI: 10.17979/JA-CEA.2024.45.10733 DIALNET GOOGLE SCHOLAR lock_openAccés obert editor

Resum

The recent proliferation of artificial intelligences (AIs), particularly generative AIs, is driving a need for transformation inuniversity education. The ability of AIs to generate content, write reports, summaries and solve problems of varying complexity should prompt a review of many traditional assessment methods, or at least a recognition of students’ ability to employ these tools in the execution of their tasks. This paper aims to assess the competencies of the main AIs currently available for carrying out tasks associated with control engineering, both theoretical and practical. The results indicate that current AIs are not yet able to solve control problems effectively, and tend to resort to standard solutions that are not always appropriate; however, they show satisfactory performance with respect to general theoretical knowledge.

Referències bibliogràfiques

  • Bethencourt-Aguilar, A., Castellanos-Nieves, D., Sosa-Alonso, J. J., Area-Moreira, M., 2023. Use of generative adversarial networks (GANs) in educational technology research. Journal of New Approaches in Educational Research. DOI: 10.7821/naer.2023.1.1231 DOI: https://doi.org/10.7821/naer.2023.1.1231
  • Divasón, J., de Pison, F. J. M., Romero, A., de Cabezón, E. S., 2023. Artificial intelligence models for assessing the evaluation process of complex student projects. IEEE Transactions on Learning Technologies 16, 694– DOI: 10.1109/TLT.2023.3246589 DOI: https://doi.org/10.1109/TLT.2023.3246589
  • Google AI, 2024. Gemini.
  • Hemachandran, K., Verma, P., Pareek, P., Arora, N., Kumar, K. V. R., Ahanger, T., Pise, A., Ratna, R., 2022. Artificial intelligence: A universal virtual tool to augment tutoring in higher education. Computational Intelligence and Neuroscience 2022. DOI: 10.1155/2022/1410448 DOI: https://doi.org/10.1155/2022/1410448
  • Jiayu, Y., 2023. Challenges and opportunities of generative artificial intelligence in higher education student educational management. Advances in Educational Technology and Psychology 7 (9). DOI: 10.23977/aetp.2023.070914 DOI: https://doi.org/10.23977/aetp.2023.070914
  • Khalil, M., Er, E., 2023. Will chatgpt get you caught? Rethinking of plagiarism detection. In: Zaphiris, P., Ioannou, A. (Eds.), Learning and Collaboration Technologies. Springer Nature Switzerland, Cham, pp. 475–487. DOI: https://doi.org/10.35542/osf.io/fnh48
  • Likert, R., 1932. A technique for the measurement of attitudes. Archives of Psychology, 1–55.
  • Lopez-Carreño, J., Calvo-Lavado, C., Azpilcueta-Vasquez, M., Zárate-Pérez, E., 2022. Artificial-intelligence-based school assistant for detecting the behavior of university students. 2022 IEEE 2nd International Conference on Advanced Learning Technologies on Education & Research (ICALTER), 1–4. DOI: 10.1109/ICALTER57193.2022.9964801 DOI: https://doi.org/10.1109/ICALTER57193.2022.9964801
  • Lund, B., Ting, W., 2023. Chatting about ChatGPT: How may AI and GPT impact academia and libraries? SSRN Electronic Journal. DOI: 10.2139/ssrn.4333415 DOI: https://doi.org/10.2139/ssrn.4333415
  • Meta Platforms, Inc., 2022. Llama 3. URL: https://llama.meta.com
  • Microsoft Corporation, 2024. Copilot Pro. URL: https://copilot.microsoft.com
  • OpenAI, 2022. ChatGPT 3.5. URL: https://chat.openai.com
  • Perplexity AI, 2022. Llama 3. URL: www.perplexity.ai
  • Popenici, S. A. D., Kerr, S., 2017. Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning 12. DOI: 10.1186/s41039-017-0062-8 DOI: https://doi.org/10.1186/s41039-017-0062-8
  • Ruiz-Rojas, L. I., Acosta-Vargas, P., De-Moreta-Llovet, J., González- Rodríguez, M., 2023. Empowering education with generative artificial intelligence tools: Approach with an instructional design matrix. Sustainability. DOI: 10.3390/su151511524 DOI: https://doi.org/10.3390/su151511524
  • Rybiński, K., Kopciuszewska, E., 2020. Will artificial intelligence revolutionise the student evaluation of teaching? A big data study of 1.6 million student reviews. Assessment & Evaluation in Higher Education 46, 1127– DOI: 10.1080/02602938.2020.1844866 DOI: https://doi.org/10.1080/02602938.2020.1844866
  • Stone, C., 2023. Artificial intelligence in social work practice education. the potential use of generative ai for learning. The Journal of Practice Teaching and Learning. DOI: 10.1921/jpts.v20i3.2192 DOI: https://doi.org/10.1921/jpts.v20i3.2192
  • UNESCO, 2023. Guidance for generative AI in education and research. URL: https://www.unesco.org/en/articles/guidance-generative-ai-education-and-research
  • Walczak, K., Cellary, W., 2023. Challenges for higher education in the era of widespread access to generative AI. Economics and Business Review 9, –100. DOI: 10.18559/ebr.2023.2.743 DOI: https://doi.org/10.18559/ebr.2023.2.743
  • Wang, J., Tan, Z., Zhou, F., Hu, Z., Fu, B., Wang, Y., 2023. Evaluation of the influence of artificial intelligence on college students’ learning based on group decision-making method. Journal of Artificial Intelligence Practice. DOI: 10.23977/jaip.2023.060805 DOI: https://doi.org/10.23977/jaip.2023.060805
  • Wang, S., 2022. The day the AGI was born. URL: https://www.latent.space/p/everything-we-know-about-chatgpt
  • Yang, C., Huan, S., Yang, Y., 2020. A practical teaching mode for colleges supported by artificial intelligence. Int. J. Emerg. Technol. Learn. 15, 195– DOI: 10.3991/ijet.v15i17.16737 DOI: https://doi.org/10.3991/ijet.v15i17.16737
  • Yeralan, S., Lee, L. A., 2023. Generative AI: Challenges to higher education. Sustainable Engineering and Innovation. DOI: 10.37868/sei.v5i2.id196 DOI: https://doi.org/10.37868/sei.v5i2.id196
  • Yi, Y., 2021. Uspostavljanje koncepta UI pismenosti: Focusing on competence and purpose. JAHR 12 (2), 353–368. DOI: 10.21860/j.12.2.8 DOI: https://doi.org/10.21860/j.12.2.8
  • Yin, Y., 2021. Research on ideological and political evaluation model of university students based on data mining artificial intelligence technology. J. Intell. Fuzzy Syst. 40, 3689–3698. DOI: 10.3233/jifs-189403 DOI: https://doi.org/10.3233/JIFS-189403
  • Yu, H., Guo, Y., Jun. 2023. Generative artificial intelligence empowers educational reform: current status, issues, and prospects. Frontiers in Education DOI: 10.3389/feduc.2023.1183162 DOI: https://doi.org/10.3389/feduc.2023.1183162
  • Zhang, E., Shi, W., 2021. The construction of university teachers’ scientific research performance evaluation system under artificial intelligence. 2021 World Automation Congress (WAC), 287–290. DOI: 10.23919/WAC50355.2021.9559607 DOI: https://doi.org/10.23919/WAC50355.2021.9559607
  • Åström, K., Hägglund, T., Apr. 2000. Benchmark systems for pid control. IFAC Proceedings Volumes 33 (4), 165–166. DOI: 10.1016/s1474-6670(17)38238-1 DOI: https://doi.org/10.1016/S1474-6670(17)38238-1
Fuente de los datos: Dialnet