CAQDAS analysis applied to student texts in social sciencies. Possibilites and limitations
DOI:
https://doi.org/10.17561/ae.v24n2.6973Keywords:
higher education, data analysis, educational technology, assessment, learning processesAbstract
The teaching analysis of content in Social Sciences faces the huge amount of texts generated by students during their learning (summaries, exams, essays, works...). Digital tools have so far not had a clear effect of teacher attendance, but we understand that this may change. We present a case study in which the CAQDAS methodology is applied to 14 undergraduate students, who worked on the concept of democracy. This results in 75 freely labeled text comments analyzed by Atlas.ti. The methodology used allowed to work effectively the multiplicity of labels, to establish a modal category system, as well as to analyze the quality and coherence of the contents. The results are considered satisfactory and demonstrate that it is possible to analyse a data set efficiently and transparently, with the support of such a methodology. This opens the door to new experiences in denser contexts.
Downloads
References
Amare, M. Y., y Simonova, S. (2021). Learning analytics for higher education: Proposal of big data ingestion architecture. SHS Web of Conferences, 92. Publicly Available Content Database; Social Science Premium Collection. https://doi.org/10.1051/shsconf/20219202002
Ávila Ruiz, R. M., Rivero Gracia, Mª. P. y Domínguez Sanz, P. L. (Coord., 2010). Metodología de investigación en Didáctica de las Ciencias Sociales. Zaragoza, Institución Fernando el Católico (CSIC).
Bai, Y., Mo, D., Zhang, L., Boswell, M. y Rozelle, S. (2016). The impact of integrating ICT with teaching: Evidence from a randomized controlled trial in rural schools in china. Computers y Education, 96, 1–14. https://dx.doi.org/10.1016/j.compedu.2016.02.005
Berrio, J. R. (1976). El método histórico en la investigación histórica de la educación. Revista Española de Pedagogía, 34(134), 449–475. http://www.jstor.org/stable/23763481
Brasil, E. y Fernandes Nascimiento, L. (2020). História digital: reflexões a partir da hemeroteca digital brasileira e do uso de caqdas na reelaboração da pesquisa histórica. Estudos Históricos (Río de Janeiro), 33(69), https://doi.org/10.1590/S2178-14942020000100011
Burton, L. J., Summers, J., Lawrence, J., Noble, K. y Gibbings, P. (2015). Digital literacy in higher education: The rhetoric and the reality. In Harmes, M. K., Huijser, H., Danaher, P. A. (Eds.), Myths in education, learning and teaching: Policies, practices and principles. New York: Palgrave MacMillan. p. 151–172.
Cantabella, M., Martínez-España, R., Ayuso, B., Yáñez, J. A., y Muñoz, A. (2019). Analysis of student behavior in learning management systems through a Big Data framework. Future Generation Computer Systems, 90, 262–272. https://doi.org/10.1016/j.future.2018.08.003
Castells, M. y Himanen, P. (2014). Reconceptualizing development in the global information age. Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780198716082.001.0001
Cebrián de la Serna, Manuel, Cebrián Robles, Daniel, Serrano Puerto, José. (2015). Metodología para evaluar el impacto de las erúbricas y las anotaciones de vídeo en las prácticas externas. En Investigar con y para la sociedad. Cádiz: AIDIPE. pp. 1457–1464.
Corrales Serrano, M., Sánchez Martín, J., Moreno Losada, J., & Zamora Polo, F. (2021). Educar en el interés social de las ciencias sociales: una intervención didáctica. Revista Prisma Social, (35), 249–276. Recuperado a partir de https://revistaprismasocial.es/article/view/4357
Dalal, K. (2016). Impact of information and communication technologies in education. International Education and Research Journal, 2(7), 25–26. Retrieved from http://ierj.in/journal/index.php/ierj/article/view/357
Elatia, S., y Ipperciel, D. (2021). Learning Analytics and Education Data Mining in Higher Education. En Azevedo, A., Azevedo, J. M., Onohuome Uhomoibhi, J. y Ossiannilsson, E. (Eds.), Advancing the Power of Learning Analytics and Big Data in Education (p. 1–19). IGI Global. https://doi.org/10.4018/978-1-7998-7103-3.ch005
Escudero Sánchez, C. L., y Cortez Suárez, L. A. (2018). Técnicas y métodos cualitativos para la investigación científica. Machala : Universidad Técnica de Machala.
Éthier, M. A. y Lefrançois, D. (2010). Los problemas de la investigación cualitativa en didáctica de las ciencias sociales. Algunos ejemplos relacionados con el aprendizaje y la enseñanza de la Historia en Quebec. En Ávila Ruiz, R. M., Rivero Gracia, Mª. P. y Domínguez Sanz, P. L. (Coord., 2010). Metodología de investigación en Didáctica de las Ciencias Sociales. Zaragoza, Institución Fernando el Católico (CSIC), pp. 29–45.
González Vera, R., Cabrera Fermoso, N. L., Mendoza Mendoza, H., y Arzate Robledo, R. (2020). Métodos de Investigación: Experimentales y Cualitativos. Alternativas en Psicología, 44, 108–120.
Hesse-Biber, S. N. (Eds., 2011). The handbook of emergent technologies in Social Research. Nueva York: Oxford University Press.
Joseph, G y Brennan, C. (2013). Framing quality: Annotated video-based portfolios of classroom practice by pre-service teachers. Early Childhood Education Journal, 41(6), 423–430. https://doi.org/10.1007/s10643-013-0576-7
Jóver, G., González Martín, M. R., y Fuentes, J. L. (2015). Exploración de nuevas vías de construcción mediática de la ciudadanía en la escuela: de Antígona a la narrativa transmedia. Teoría de la Educación; Revista Interuniversitaria, 27(1), 69–84. https://doi.org/10.14201/teoredu20152716984
Kean Ang, C., Amin Embi, M., Md, y Yunus, M. (2016). Enhancing the quality of the findings of a longitudinal case study: Reviewing trustworthiness via ATLAS.ti. The Qualitative Report, 21(10), 1855–1867. https://doi.org/10.46743/2160-3715/2016.2480
Lewthwaite, S., y Nind, M. (2016) Teaching Research Methods in the Social Sciences: Expert Perspectives on Pedagogy and Practice. British Journal of Educational Studies, 64:4, 413–430, https://doi.org/10.1080/00071005.2016.1197882
Liao, H., Chen, L., Song, Y., y Ming, H. (2016). Visualization-based active learning for video annotation. IEEE Transactions on Multimedia, 18(11), 2196–2205. https://doi.org/10.1109/TMM.2016.2614227
Marchis, G. (2016). New horizons for innovation in european higher education institutions. EIRP Proceedings, 11(1), 405–411. Retrieved from https://doaj.org/article/019d0593f8ae4ed78e82e2bcb532e01d
Martín Antón, J., Valdés-Gonzaléz, A., & Jimeno Rodríguez, D. . (2021). portugués Elección, análisis y uso de herramientas didácticas para la enseñanza de las Ciencias Sociales. La importancia de la detección de anacronismos y falta de rigor histórico en un videojuego. Riaices, 3(2), 17–26. Recuperado a partir de https://reunido.uniovi.es/index.php/riaices/article/view/16797
Miller, R. E. (2014). Plagiarism curricula may reduce need for punitive plagiarism education. Evidence Based Library and Information Practice, 9(1), 39–41. Retrieved from https://goo.gl/WXodGS
Monedero Moya, J. J., Cebrián Robles, D., y Desenne, P. (2015). Usabilidad y satisfacción en herramientas de anotaciones multimedia para MOOC. Comunicar, (44), 55–62. https://doi.org/10.3916/C44-2015-06
Monteagudo-Fernández, J., Rodríguez Pérez, R. A., Escribano-Miralles, A., y Rodríguez García, A. M. (2020). Percepciones de los estudiantes de Educación Secundaria sobre la enseñanza de la historia, a través del uso de las TIC y recursos digitales. Revista Electrónica Interuniversitaria de Formación del Profesorado, 23(2). https://doi.org/10.6018/reifop.417611
Navarro Ibarra, L. A., Cuevas Salazar, O., y Martínez Castillo, J. (2017). Meta-análisis sobre educación vía TIC en méxico y américa latina. REDIE, Revista Electrónica De Investigación Educativa., 19(1), 10–19. Retrieved from https://goo.gl/P6iKGl
Noguera Fructuoso, I. (2015). How millennials are changing the way we learn: The state of the art of ICT integration in education. RIED: Revista Iberoamericana De Educación a Distancia, vol 18, nº 1, 45–65. Retrieved from https://goo.gl/BEpnk2
Olapane, E. C. (2021). An In-depth Exploration on the Praxis of Computer-assisted Qualitative Data Analysis Software (CAQDAS). Journal of Humanities and Social Sciences Studies, 3(11), 57–78. https://doi.org/10.32996/jhsss.2021.3.11.5
Ornellas, A. y Sancho, J. (2015). Three decades of digital ICT in education: Deconstructing myths and highlighting realities. In Harmes, M. K., Huijser, H. y Danaher, P. A. (Eds.), Myths in education, learning and teaching. New York: Palgrave MacMillan. p. 135–150.
Paredes Quiroz, L. A. (2020). El uso de ATLAS.ti en la investigación histórica: el caso del análisis iconológico de monumentos funerarios. Caleidoscopio - Revista Semestral de Ciencias Sociales y Humanidades, 24(43). https://doi.org/10.33064/43crscsh2441
Paulus, T. M., y Bennett, A. M. (2017). ’I have a love-hate relationship with ATLAS.ti’TM: Integrating qualitative data analysis software into a graduate research methods course. International Journal of Research y Method in Education, 40(1), 19–35. https://doi.org/10.1080/1743727X.2015.1056137
Ruser, A. (2021). Hijacking the Postmodern Project: Post-Truth and the Need to De-politicize Epistemological Dispute. Social Epistemology, https://doi.org/10.1080/02691728.2021.2004621
Sang-Keun, S. (2015). Teaching critical, ethical, and safe use of ICT to teachers. Language Learning y Technology: A Refereed Journal for Second and Foreign Language Educators, 19(1), 181–197. Retrieved from https://goo.gl/AsIgX2
Seidman, I. (2013). Interviewing as Qualitative Research: A Guide for Researchers in Education and the Social Sciences. New York, NY: Teachers College Press.
Sokal, A. D. (1996). Transgressing the Boundaries: Towards a Transformative Hermeneutics of Quantum Gravity. Social Text, 46/47, 217–252.
Torres-Madroñero, M. C., & Torres-Madroñero, E. M. (2020). PazRed. Una propuesta de educación virtual para la formación de estudiantes universitarios en competencias para las Ciencias Sociales. Trilogía Ciencia Tecnología Sociedad, 12(23), 37–59. https://doi.org/10.22430/21457778.1715
Trigueros Cano, F. J., Sánchez Ibáñez, R., y Vera Muñoz, M. I. (2012). The professorship of primary education before the ITC: reality and challenges. Revista Electrónica Interuniversitaria de Formación del Profesorado, 15(1), 101–112. Retrieved from https://goo.gl/dX3t5m
Valbuena, R. (2021). El ocaso de las Ciencias Sociales: crítica fundamentada a su metodología. Maracaibo: Cencal.
Westhuizen, C. P., y Golightly, A. (2015). Video annotation software application for thorough collaborative assessment of and feedback on microteaching lessons in geography education. Journal of Geography in Higher Education, 39(3), 420–436. https://doi.org/10.1080/03098265.2015.1053802
Woods, M., Paulus, T., Atkins, D. P., y Macklin, R. (2016). Advancing qualitative research using qualitative data analysis software (QDAS)? Reviewing potential versus practice in published studies using ATLAS.ti and NVivo, 1994–2013. Social Science Computer Review, 34(5), 597–617. https://doi.org/10.1177/0894439315596311
Woods, M., Macklin, R., y Lewis. G. K. (2016). Researcher reflexivity: exploring the impacts of CAQDAS use. International Journal of Social Research Methodology, 19:4, 385–403, https://doi.org/10.1080/13645579.2015.1023964
Yunita, A., Santoso, H. B., y Hasibuan, Z. A. (2021). Research Review on Big Data Usage for Learning Analytics and Educational Data Mining: A Way Forward to Develop an Intelligent Automation System. Journal of Physics: Conference Series, 1898(1), 012044. https://doi.org/10.1088/1742-6596/1898/1/012044
Published
Issue
Section
License
Copyright (c) 2022 Daniel David Martínez Romera, Sara Cortés Dumont
This work is licensed under a Creative Commons Attribution 4.0 International License.
The authors who publish in this journal agree with the following terms:
The authors retain the copyright and guarantee the journal the right to be the first publication of the work as well as a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the authorship of the work and the initial publication in this magazine.
Authors may separately establish additional agreements for the non-exclusive distribution of the version of the work published in the journal (for example, place it in an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
Authors are allowed and encouraged to disseminate their work electronically (for example, in institutional repositories or on their own website) before and during the submission process, as it may result in productive exchanges, as well as a more early and major published papers (See The Effect of Open Access).
