Evaluation of virtual Reality Objects in education: analysis of usability, technical, and aesthetic aspects by students

Número

DOI

https://doi.org/10.25267/Hachetetepe.2025.i30.1101

Info

Monographic
1101
Published: 02-01-2025
PlumX

Authors

Abstract

The research evaluates the usability, technical, and aesthetic aspects of a virtual reality (VR) object from the perspective of university students. A non-experimental, descriptive, and comparative design with a quantitative and cross-sectional approach was employed. Using the System Usability Scale (SUS) and specific items for technical and aesthetic aspects, two versions of the same VR object were analyzed. The sample included 324 students from the Faculty of Communication and the Faculty of Education Sciences at the University of Seville. The results indicated that both versions achieved high scores on the SUS scale, suggesting an adequate level of usability. However, significant differences were identified between the versions, with the one incorporating video clips, audio, and maps perceived as more usable. In terms of technical and aesthetic aspects, no significant differences were found, although one version received a slightly higher rating for aesthetic quality. The findings highlight the importance of designing VR objects that are technologically advanced, easy to use, and visually appealing to optimize their educational potential.

Keywords


Downloads

Download data is not yet available.

Supporting Agencies  

This study has received funding through the Programa Estatal para Promover la Investigación Científica y Tecnológica y su Transferencia, within the framework of the Plan Estatal de Investigación Científica, Técnica y de Innovación 2021-2023. Ministry of Science and Innovation. Reference number: PID2022-136430OB-I00.

How to Cite

Cabero Almenara, J., Miravete Gracia , M., Serrano Hidalgo, M., & Núñez Domínguez , T. (2025). Evaluation of virtual Reality Objects in education: analysis of usability, technical, and aesthetic aspects by students. Hachetetepé. Scientific Journal of Education and Communication, (30), 1101. https://doi.org/10.25267/Hachetetepe.2025.i30.1101

Author Biographies

Julio Cabero Almenara, Universidad de Sevilla

Julio Cabero Almenara holds a Ph.D. in Educational Sciences and is a Full Professor of Educational Technology at the University of Seville. He has published numerous books and articles both nationally and internationally. He currently serves as the Director of the Secretariat for Audiovisual Resources and New Technologies at the University of Seville.

María Miravete Gracia , Universidad Internacional de Andalucía

María Miravete Gracia is a doctoral candidate in Educational Technology at the International University of Andalusia. She has contributed to the coordination and authorship of scientific publications and delivers training on the application of virtual reality in university teaching at the Institute of Educational Sciences and the International University of Andalusia.

Manuel Serrano Hidalgo, Universidad de Sevilla

Manuel Serrano Delgado is PhD in Education. Technical Director of the Secretariat of Educational Innovation of the University of Seville. Member of the Didactic Research Group: technological and qualitative analysis of teaching-learning processes (HUM390) of the Junta de la Andalucía. Participant in research projects with the government of Spain and the Junta de Andalucía. Professor in national and international university master's degrees. Trainer of university professors in aspects related to educational technology. Member of the technical team of the Pixel Bit Magazine. Magazine of Media and Education.

Trinidad Núñez Domínguez , Universidad de Sevilla

Trinidad Núñez Domínguez is a professor at the University. She is attached to the Department of Social Psychology at the University of Seville and has been linked to the Faculty of Communication since its inception. Her areas of research interest are media and gender; educommunication and media diet, and media and immigration. She has participated in almost a dozen research projects, both national and European. In 2013 she received two significant awards: the Meridiana 2013 Award for initiatives that promote the value of equality in young people, awarded by the Junta de Andalucía, and the XX Carmen de Burgos Award for feminist dissemination, awarded by the University of Malaga.

References

Alpizar, D., Adesope, O. O., y Wong, R. M. (2020). A meta-analysis of signaling principle in multimedia learning environments. Educational Technology Research and Development, 68(5), 2095–2119. https://doi.org/10.1007/s11423-020-09748-7

Banjar, A., Xu, X., Iqbal, Z. y Campbell, A. (2023). A systematic review of the experimental studies on the effectiveness of mixed reality in higher education between 2017 and 2021. Computers & Education: X Reality, 3, 100034, https://doi.org/10.1016/j.cexr.2023.100034

Barroso, J., Cabero, J., y Llorente, C. (2015). El diseño, la producción y la evaluación de TIC aplicadas a los procesos de enseñanza-aprendizaje. En J. Cabero y J. Barroso (Coords.)., Nuevos retos en tecnología educativa (pp. 69-85). Síntesis.

Brooke, J. (1996). SUS: A “quick and dirty” usability scale. En P. Jordan, B. Thomas, y B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). Taylor & Francis.

Brown, M., McCormack, M., Reeves, J., Brooks, D. C., y Grajek, S. (2020). 2020 EDUCAUSE Horizon Report, Teaching and Learning Edition. EDUCAUSE. https://eric.ed.gov/?id=ED607329.

Cabero, J., y Llorente, C. (2023). Tecnologías y metodologías emergentes. En C. Llorente y J. J. Gutiérrez (Coords.), Tecnologías emergentes y pedagogía de la innovación (pp. 11-24). Dykinson.

Cabero-Almenara, J., De-La-Portilla, F., Barroso-Osuna, J., y Palacios-Rodríguez, A. (2023). Health Sciences: Improving the Motivation and Performance of Medical Students with Immersive Reality. Applied Sciences, 13(1), 8420. https://doi.org/10.3390/app13148420

Cabero-Almenara, J., Llorente Cejudo, M. C., y Gutiérrez-Castillo, J. J. (2017). Los alumnos como evaluadores de objetos de aprendizaje en Realidad Aumentada. RED. Revista de Educación a Distancia, (53), 1-17. https://doi.org/10.6018/red/53/4

Cabero-Almenara, J., Llorente-Cejudo, C., y Martinez-Roig, R. (2022). The use of mixed, augmented and virtual reality in history of art teaching: A case study. Applied System Innovation, 5(3). 44.

https://doi.org/10.3390/asi5030044

Cabero-Almenara, J., Serrano-Hidalgo, M., Palacios-Rodríguez, A., y Llorente-Cejudo, C. (2022). El alumnado universitario como evaluador de materiales educativos en formato t-MOOC para el desarrollo de la Competencia Digital Docente según DigCompEdu. Comparación con juicio de expertos. Edutec. Revista Electrónica de Tecnología Educativa, (81), 1-17. https://doi.org/10.21556/edutec.2022.81.2503

Campos Soto, M. N., Navas-Parejo, M. y Moreno, A.J. (2020). Realidad virtual y motivación en el contexto educativo: Estudio bibliométrico de los últimos veinte años de Scopus. Alteridad. Revista de Educación, 15(1), 47-62. https://doi.org/10.17163/alt.v15n1.2020.04

Chen, Y., Li, M., y Cukurova, M. (2024). Unleashing imagination: an effective pedagogical approach to integrate into spherical video-based virtual reality to improve students’ creative writing. Education and Information Technologies, 29, 6499–6523. https://doi.org/10.1007/s10639-023-12115-7

Christopoulos, A., Pellas, N., Qushem, U., y Laakso, M. (2023). Comparing the effectiveness of video and stereoscopic 360° virtual reality-supported instruction in high school biology courses. British Journal of Educational Technology, 54, 987–1005. https://doi.org/10.1111/bjet.13306.CorrCorregido

Conrad, M., Kablitz, D. y Schumann, S. (2024). Learning effectiveness of immersive virtual reality in education and training: A systematic review of findings. Computers y Education: X Reality, 4. https://doi.org/10.1016/j.cexr.2024.100053

Del Valle, M., y Zamora, L. (2022). El uso de las medidas de auto-informe: ventajas y limitaciones en la investigación en Psicología. Alternativas Psicológicas, 47, 22-35.

Devin, F. (2017). Sistema de Escalas de Usabilidad: ¿qué es y para qué sirve? UUXpañol. https://acortar.link/TorfBD

Espinoza-Castro, K. E., Plaza-Chalco, J. L., Bravo-Guzhñay, B. F. y Mogrovejo-Mogrovejo, E. M. (2024). Realidad Virtual y educación: retos y propuestas desde actores educativos del bachillerato público en Ecuador. Atenas, 62, 1-13.

Fromm, J., Radianti, J., Wehking, C., Stieglitz, S., Majchrzak, T. A., y vom Brocke, J. (2021). More than experience? - On the unique opportunities of virtual reality to afford a holistic experiential learning cycle. The Internet and Higher Education, 50, 1-14. https://https:doi.org/10.1016/j.iheduc.2021.100804

Gimeno, S. (2018). Cinco formas de interpretar un SUS. Torresburriel. https://torresburriel.com/weblog/cinco-formas-de-interpretar-un-sus/.

Gonzáles, H., Moreno, Y. y Pincheira, M. (2024). Realidad virtual inmersiva como complemento en la educación odontológica: un proceso de implementación para la docencia. Educación Médica, 25, 100931, https://doi.org/10.1016/j.edumed.2024.100931

Gronier, G., y Baudet, A. (2021). Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability Scale. International Journal of Human–Computer Interaction, 37(16), 1571-1582. https://https:doi.org/10.1080/10447318.2021.1898828

Herranz, J., Caerolds, M., y Sidorenko, P. (2019). La realidad virtual y el vídeo 360º en la comunicación empresarial e institucional. Revista de Comunicación, 18(2), 177-199.

Kartiko, I., Kavakli, M., y Cheng, K. (2010). Learning science in a virtual reality application: The impacts of animated-virtual actors’ visual complexity. Computers y Education, 55, 881-891.

Lai, J. W., y Cheong, K. H. (2022). Adoption of Virtual and Augmented Reality for Mathematics Education: A Scoping Review. IEEE Access, 10, 13693-13703. https://doi.org/10.1109/ACCESS.2022.3145991

Lee, D. y Shea, M. (2020). Exploring the use of virtual reality by pre-service elementary teachers for teaching science in the elementary classroom. Journal of Research on Technology in Education, 52(2), 163-177. https://doi.org/10.1080/15391523.2020.1726234

Lewis, J. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction, 34(7), 577-590. https://doi.org/10.1080/10447318.2018.1455307

Liu, Z., Zhang, W., y Hu, L. (2024). Can desktop virtual reality effectively enhance academic achievement? A meta-analysis. Innovations in Education and Teaching International, 1–16. https://doi.org/10.1080/14703297.2024.2354753

López-Belmonte, J., Dúo-Terrón, P., Moreno-Guerrero, A.-J., y Marín-Marín, J.-A. (2024). Efectos de la realidad aumentada y virtual en estudiantes con TEA. Pixel-Bit. Revista De Medios Y Educación, (70), 7-23 https://doi.org/10.12795/pixelbit.103789.

Makransky, G., Terkildsen, T., y Mayer, R. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236. https://doi.org/10.1016/j.learninstruc.2017.12.007

Marín, V., Sampedro, B., y Vega, E. (2022). Promoviendo el aprendizaje a través del uso de videos en 360º. Innoeduca. International Journal of Technology and Educational Innovation, 8(2), 138-151. https://doi.org/10.24310/innoeduca.2022.v8i2.15120

Mayer, R. E. (2002). Multimedia learning. Psychology of Learning and Motivation, 41, 85–139.

Mayer, R. E. (2021). Multimedia learning. Cambridge University Press.

Mayer, R., Makransky, G., y Parong, J. (2023). The Promise and Pitfalls of Learning in Immersive Virtual Reality. International Journal of Human–Computer Interaction, 39(11), 2229-2238. https://doi.org/10.1080/10447318.2022.2108563

Mulders, M., Buchner, J., y Kerres, M. (2020). A Framework for the Use of Immersive Virtual Reality in Learning Environments. International Journal of Emerging Technologies in Learning (iJET), 15(24), 208-224. https://doi.org/10.3991/ijet.v15i24.16615

O'Dwyer, L., y Bernauer, J. A. (2014). Quantitative research for the qualitative researcher. Sage.

Parong, J., y Mayer, R. E. (2021). Learning about history in immersive virtual reality: does immersion facilitate learning? Education Tech Research Dev, 69, 1433–1451. https://doi.org/10.1007/s11423-021-09999-y

Pedrosa, M. (2022). ¿La usabilidad puede medirse? Escala SUS y test de usuario. Flat101. https://acortar.link/bh68t1

Radianti, J., Majchrzak, T., Fromm, J., y Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Computers y Education, 147, 1-29. https://doi.org/10.1016/j.compedu.2019.103778

Rauschnabel, F., Felix, R., Hinsch, C., Shahab, H., y Alt, F. (2022). What is XR? Towards a Framework for Augmented and Virtual Reality. Computers in Human Behavior, 133, 107289. https://doi.org/10.1016/j.chb.2022.107289

Torres, D. (2018). Usabilidad. Deja de sufrir. Anaya Multimedia.

Valero-Franco, C., y Berns, A. (2024). Desarrollo de apps de realidad virtual y aumentada para enseñanza de idiomas: Un estudio de caso. RIED-Revista Iberoamericana de Educación a Distancia, 27(1), 163-185. https://doi.org/10.5944/ried.27.1.37668

Wang, J., Ma, Q., y Wei, X. (2023). The Application of Extended Reality Technology in Architectural Design: A review. Buildings, 13, 2931. https://doi.org/10.3390/buildings13122931

Zilles, E. (2020). Audiovisuales ampliados en la realidad virtual: inmersión, multisensorial y escenarios 360°. Sphera Publica, 1(20), 78–94. https://acortar.link/pDRPGW