Design and validation of an instrument to analyze educational YouTube channels

Main Article Content

Daniel Pattier

Abstract

The emerging challenges of current education have led to the appearance of successful innovative collectives from the field of communication. Among them, edutubers, creators of educational audiovisual content on YouTube, stand out as one of the most influential. In order to study the presence of these channels on the platform, a qualitative analysis instrument for educational YouTube channels is designed and validated. An instrument is proposed consisting of 41 items grouped into 7 categories on various aspects of a public nature of the channels (dependent variables, channel data and statistics, structuring of the videos, recording and editing process, personality of the content creator, use of the YouTube platform and use of other social networks). A total validation of the instrument is developed through a content, criteria and construct validation. The results are discussed with the most recent literature on the subject. The projection of this instrument is concluded as a fundamental basis for evaluating the presence of educational channels on the YouTube platform.

Downloads

Download data is not yet available.

Article Details

Section

DIGITAL CULTURES IN SOCIAL NETWORKS

Author Biography

Daniel Pattier, Complutense University of Madrid

Daniel Pattier is a researcher in training at the Department of Educational Studies of the Faculty of Education of the Complutense University of Madrid (UCM), calle del Rector Royo-Villanova, 1, 28040, Madrid (Spain). Email: dpattier@ucm.es. His main lines of research focus on the use of communication platforms and social networks in education and on the implementation of evidence-based educational practices. It is part of projects on these topics at the national level (R + D + i: #LobbyingTeachers - Theoretical foundations, political structures and social practices of public-private relations in the field of teachers in Spain) and international (Erasmus +: EIPSI - Evidence Informed Practice for School Inclusion), and has published numerous articles of impact on the matter.

How to Cite

Pattier, D. (2022). Design and validation of an instrument to analyze educational YouTube channels. Journal ICONO 14, 20(2). https://doi.org/10.7195/ri14.v20i2.1818

References

Aguaded, Ignacio & Medina-Salguero, Rosario. (2015). Criterios de calidad para la valoración y gestión de MOOC. RIED. Revista Iberoamericana de Educación a Distancia, 18(2), 119-143. https://doi.org/10.5944/ried.18.2.13579

Aiken, Lewis R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012

Amarasekara, Inoka & Grant, Will J. (2019). Exploring the YouTube science communication gender gap: A sentiment analysis. Public Understanding of Science, 28(1), 68-84. https://doi.org/10.1177/0963662518786654

Ambrose, Susan A.; Bridges, Michael W.; DiPietro, Michele; Lovett, Marsha C.; & Norman, Marie K. (2010). How learning works: Seven research-based principles for smart teaching. John Wiley & Sons.

Arya, Poonam; Christ, Tanya; & Chiu, Ming Ming. (2016). Video use in teacher education: a survey of teacher-educators’ practices across disciplines. Journal of Computing in Higher Education, 28(2), 261-300. https://doi.org/10.1007/s12528-016-9116-y

Bardakcı, Salih (2019). Exploring high school students' educational use of YouTube. International Review of Research in Open and Distributed Learning, 20(2), 260-278. https://doi.org/10.19173/irrodl.v20i2.4074

Bautista, Alfredo; Tan, Clarence; Wong, Joanne; & Conway, Colleen. (2019). The role of classroom video in music teacher research: a review of the literature. Music Education Research, 21(4), 331-343. https://doi.org/10.1080/14613808.2019.1632278

Beheshti, Mobina; Taspolat, Ata; Kaya, Omer Sami; & Sapanca, Hamza Fatih. (2018). Characteristics of Instructional Videos. World Journal on Educational Technology: Current Issues, 10(2), 79-87. https://doi.org/10.18844/wjet.v10i2.3418

Beltrán-Pellicer, Pablo; Giacomone, Belén; & Burgos, María. (2018). Online educational videos according to specific didactics: The case of Mathematics. Culture and Education, 30(4), 633-662. https://doi.org/10.1080/11356405.2018.1524651

Biggs, John. (2006). Calidad del aprendizaje universitario. Narcea.

Bohloko, Matau; Makatjane, Tiisetso J.; George, Mosotho J. y Mokuku, Tsepo. (2019). Assessing the effectiveness of using YouTube videos in teaching the chemistry of group i and vii elements in a high school in Lesotho. African Journal of Research in Mathematics, Science and Technology Education, 23(1), 75-85. https://doi.org/10.1080/18117295.2019.1593610

Burgos, María; Beltrán-Pellicer, Pablo; & Godino, Juan D. (2020). La cuestión de la idoneidad de los vídeos educativos de matemáticas. Revista Española de Pedagogía, 78(275), 27-50. https://doi.org/10.22550/rep78-1-2020-07

Cabrera, Leopoldo. (2020). Efectos del coronavirus en el sistema de enseñanza: aumenta la desigualdad de oportunidades educativas en España. Revista de Sociología de la Educación-RASE, 13(2), 114-139. https://doi.org/10.7203/rase.13.2.17125

Chen, Cheryl Wei-Yu. (2020). Analyzing online comments: a language-awareness approach to cultivating digital literacies. Computer Assisted Language Learning, 33(4), 435-454. https://doi.org/10.1080/09588221.2019.1569068

Cheng, Xu; Mehrdad, Fatourechi; Ma, Xiaoqiang; Zhang, Cong; & Liu, Jiangchuan. (2014). Understanding the YouTube partners and their data: measurement and analysis. China Communications, 11(12), 26-34. https://doi.org/10.1109/cc.2014.7019837

Closson, Leanna M. & Bond, Takara A. (2019). Social network site use and university adjustment. Educational Psychology, 39(8), 1027-1046. https://doi.org/10.1080/01443410.2019.1618443

Darby, Flower & Lang, James M. (2019). Small teaching online: Applying learning science in online classes. John Wiley & Sons.

De-la-Fuente-Sánchez, Damián; Solís, Montserrat H.; & Martos, Inmaculada P. (2018). Vídeo educativo y rendimiento académico en la enseñanza superior a distancia. Revista Iberoamericana de Educación a Distancia, 21(1), 323-341. https://doi.org/10.5944/ried.21.1.18326

Di Paolo, Terry; Wakefield, Jenny S.; Mills, Leila A.; & Baker, Laura. (2017). Lights, camera, action: Facilitating the design and production of effective instructional videos. TechTrends, 61(5), 452-460. https://doi.org/10.1007/s11528-017-0206-0

Encinas-Martín, Marta. (2020). Spain: Aprendo en casa (Learn at home), Education continuity stories series. OECD Publishing.

Escurra, Luis Miguel; Delgado, Ana; Quesada, María Rosario; Rivas, Gerardo; Santos, Julio; & Pequeña, Juan. (2014). Adaptación psicométrica del test de operaciones formales combinatorias (T.O.F.C.) de Longeot de acuerdo al modelo de Mokken. Revista de Investigación en Psicología, 2(2), 57-77. https://doi.org/10.15381/rinvp.v2i2.4878

Fernández, Carolina. (2014). Prácticas transmedia en la era del prosumidor: hacia una definición de contenido generado por el usuario. Cuadernos de Información y Comunicación, 19, 53-67. https://doi.org/10.5209/rev_ciyc.2014.v19.43903

García-Martín, Sheila & Cantón-Mayo, Isabel. (2019). Teachers 3.0: Patterns of use of five digital tools. Digital Education Review, 35, 202-215. https://doi.org/10.1344/der.2019.35.202-215

García-Peñalvo, Francisco José; Corell, Alfredo; Abella-García, Víctor; & Grande, Mario. (2020). La evaluación online en la educación superior en tiempos de la COVID-19. Education in the Knowledge Society, 21, 1-26. https://doi.org/10.14201/eks.23013

Junco, Reynol. (2015). Student class standing, Facebook use, and academic performance. Journal of Applied Developmental Psychology, 36, 18-29. https://doi.org/10.1016/j.appdev.2014.11.001

León-Gómez, Alicia; Gil-Fernández, Raquel; & Calderón-Garrido, Diego. (2021). Influence of COVID on the educational use of Social Media by students of Teaching Degrees. Education in the Knowledge Society (EKS), 22, e23623. https://doi.org/10.14201/eks.23623

López, Luis; Maza-Córdoba, Jorge; & Tusa, Fernanda. (2020). Educar en el contexto digital: el reto de ser edutuber. Revista Ibérica de Sistemas e Tecnologias de Informação, (E25), 188-200. https://bit.ly/3qnyHBS

Manotas Salcedo, Edna Margarita; Pérez Rodríguez, Amor; & Contreras Pulido, Paloma. (2018). Propuesta de diseño de instrumento para analizar vídeo-lecciones en MOOC. Alteridad, 14(1), 53-64. https://doi.org/10.17163/alt.v14n1.2019.04

Maraza-Quispe, Benjamín; Alejandro-Oviedo, Olga; Fernández-Gambarini, Walter; Cisneros-Chavez, Betsy; & Choquehuanca-Quispe, Walter. (2020). Análisis de YouTube como herramienta de investigación documental en estudiantes de educación superior. PUBLICACIONES, 50(2), 133-147. https://doi.org/10.30827/publicaciones.v50i2.13949

Marcelo, Carlos & Marcelo, Paula. (2021). Influencers educativos en Twitter. Análisis de hashtags y estructura relacional. Comunicar, 68, 73-83. https://doi.org/10.3916/C68-2021-06

Moreira, José Antonio. M.; Santana, Camila Lima; & Bengoechea, Aitor G. (2019). Enseñanza y aprendizaje en redes sociales digitales: el caso Mathgurl en YouTube. Revista de la SEECI, (50), 107-127. https://doi.org/10.15198/seeci.2019.50.107-127

Moussiades, Lefteris; Kazanidis, Ioannis; & Iliopoulou, Anthi. (2019). A framework for the development of educational video: An empirical approach. Innovations in Education and Teaching International, 56(2), 217-228. https://doi.org/10.1080/14703297.2017.1399809

Neumann, Michelle M. & Herodotou, Christothea. (2020). Evaluating YouTube videos for young children. Education and Information Technologies, 25(5), 4459-4475. https://doi.org/10.1007/s10639-020-10183-7

OECD (2020). STIP Covid-19 Watch. OECD Survey on the science and innovation policy responses to coronavirus (Covid-19). https://stip.oecd.org/Covid.html

Pattier, Daniel. (2021a). Referentes educativos durante la pandemia de la COVID-19: El éxito de los edutubers. PUBLICACIONES, 51(3), 533-563. https://doi.org/10.30827/publicaciones.v51i3.18080

Pattier, Daniel. (2021b). The gender gap among EduTubers and the factors significantly influencing it. Journal of New Approaches in Educational Research, 10(2), 313-329. https://doi.org/10.7821/naer.2021.7.732

Pattier, Daniel. (2021c). Science on Youtube: Succesful Edutubers. TECHNO REVIEW. International Technology, Science and Society Review, 10(1), 1-15. https://doi.org/10.37467/gka-revtechno.v10.2696

Pattier, Daniel. (2021d). Educating in Art and Culture through Youtube: The impact of edutubers. Komunikacija i Kultura Online, 12(12), 167–181. https://doi.org/10.18485/kkonline.2021.12.12.10

Pérez-Narváez, Marco Vinicio & Tufiño, Alex. (2020). Teleeducación y COVID-19. CienciAmérica, 9(2), 58-64. https://doi.org/10.33210/ca.v9i2.296

Ramírez-Ochoa, María Isabel. (2016). Posibilidades del uso educativo de YouTube. Ra Ximhai, 12(6), 537-546. https://doi.org/10.35197/rx.12.01.e3.2016.34.mr

Ranga, Jayashree S. (2017). Customized videos on a YouTube Channel: A beyond the classroom teaching and learning platform for general chemistry courses. Journal of Chemical Education, 94(7), 867-872. https://doi.org/10.1021/acs.jchemed.6b00774

Rangarajan, Karan; Begg, Khalil; & Somani, Bhaskar. (2019). Online digital media: the uptake of YouTube-based digital clinical education (DCE). American Journal of Distance Education, 33(2), 142-150. https://doi.org/10.1080/08923647.2019.1582308

Rego-Rey, Sandra & Romero-Rodríguez, Luis M. (2016). Representación discursiva y lenguaje de los youtubers españoles: Estudio de caso de los gamers más populares. Index Comunicación, 6(1), 197-224. https://bit.ly/3ySeCHK

Regueira, Uxía; Alonso-Ferreiro, Almudena; & Da-Vila, Sergio. (2020). La mujer en YouTube: Representación y participación a través de la técnica Web Scraping. Comunicar, 28(63), 31-40. https://doi.org/10.3916/c63-2020-03

Rodríguez, Martha Claudia & Fernández, Jessica. (2017). Uso del recurso de contenido del aprendizaje en línea: YouTube. Apertura, 9(1), 22-31. https://doi.org/10.32870/ap.v9n1.1018

Roque Rodríguez, Ernesto. (2020). Tutoriales de Youtube como estrategia de aprendizaje no formal en estudiantes universitarios. RIDE Revista Iberoamericana para la Investigación y el Desarrollo Educativo, 11(21). https://doi.org/10.23913/ride.v11i21.797

Sahayu, Wening & Friyanto. (2019). The effect of YouTube on high school students' second language acquisition. International Journal of Linguistics, literature and Translation, 2(6), 38-44. https://bit.ly/3z0Tu2g

Santos Espino, José Miguel; Afonso Suárez, María Dolores; & González-Henríquez, Juan José. (2020). Video for teaching: classroom use, instructor self-production and teachers’ preferences in presentation format. Technology, Pedagogy and Education, 29(2), 147-162. https://doi.org/10.1080/1475939x.2020.1726805

Sarkar, Nina; Ford, Wendy; & Manzo, Christina. (2019). To flip or not to flip: What the evidence suggests. Journal of Education for Business, 95(2), 81-87. https://doi.org/10.1080/08832323.2019.1606771

Saurabh, Samant & Gautam, Sanjana. (2019). Modelling and statistical analysis of YouTube's educational videos: A channel Owner's perspective. Computers & Education, 128, 145-158.

https://doi.org/10.1016/j.compedu.2018.09.003

Segarra-Saavedra, Jesús & Hidalgo-Marí, Tatiana. (2018). Viralidad e interacción. Análisis del engagement de los diez anuncios más vistos en YouTube en España en 2016. Icono14. Revista Científica de Comunicación y Tecnologías Emergentes, 16(1), 47-71. https://doi.org/10.7195/ri14.v16i1.1069

Staudt Willet, K. Bret. (2019). Revisiting how and why educators use Twitter: Tweet types and purposes in #Edchat. Journal of Research on Technology in Education, 51(3), 273-289.

https://doi.org/10.1080/15391523.2019.1611507

Szeto, Elson; Cheng, Annie Yan-Ni; & Hong, Jon-Chao. (2016). Learning with social media: How do preservice teachers integrate YouTube and social media in teaching?. The Asia-Pacific Education Researcher, 25(1), 35-44. https://doi.org/10.1007/s40299-015-0230-9

Tiernan, Peter & O’Kelly, Jane. (2019). Learning with digital video in second level schools in Ireland. Education and Information Technologies, 24(2), 1073-1088. https://doi.org/10.1007/s10639-018-9811-6

Vizcaíno-Verdú, Arantxa; Contreras-Pulido, Paloma; & Guzmán-Franco, María Dolores. (2019) Reading and informal learning trends on YouTube: The booktuber. Comunicar, 27(59), 93-101. https://doi.org/10.3916/c59-2019-09

Walsh, John N.; O'Brien, Michael P.; & Slattery, Darina M. (2019) Video viewing patterns using different teaching treatments: A case study using YouTube analytics. Research in Education & Learning Innovation Archives (REALIA), 22, 77-95. https://doi.org/10.7203/realia.22.15389

Wilson, Linus & Wu, Yan Wendy. (2020). Crowdfunding on Patreon by YouTube sailing channels. SSRN, 1-32: http://dx.doi.org/10.2139/ssrn.2919840

Yukselir, Ceyhun & Komur, Sevki. (2017). Using online videos to improve speaking abilities of EFL learners. European Journal of Education Studies, 3(5), 255-266. https://bit.ly/3JdyCJx

Zureick, Andrew H.; Burk‐Rafel, Jesse; Purkiss, Joel A.; & Hortsch, Michael. (2018). The interrupted learner: How distractions during live and video lectures influence learning outcomes. Anatomical Sciences Education, 11(4), 366-376. https://doi.org/10.1002/ase.1754