EVALOE-DSS as a self-assessment and decision-making tool on the teaching of oral language in a school context: results of a pilot study

  • Marta Gràcia Universitat de Barcelona
  • Laura Amado Universitat Abat Oliba-CEU
  • Sonia Jarque Universitat de Barcelona
  • Daniela Bitencourt
  • Fàtima Vega Universitat de Barcelona
  • Carles Riba Universitat de Barcelona
Keywords: self-assessment, communicative and linguistic competence, Decision Support System (DSS), school, reflection, decision-making.

Abstract

School is a natural context for development in which the communicative strategies used by teachers when interacting with students are essential for the development of communicative and linguistic competence. The objective of this study was to construct, implement and validate a first version of a self-assessment and decision-making tool on the teaching of oral language at school. It is an adaptation of the Oral Language Assessment in the School Context Scale (Escala de Valoración de la enseñanza de la Lengua Oral en contexto Escolar-EVALOE) (Gràcia et al., 2015) based on the use of the Conversational Methodology. This is a multiple case study focusing on four teachers (1 from an ordinary school, 2 from a rural school and 1 from a special education school). For six months, the teachers self-assessed their teaching practices with the tool, made decisions to improve it, and introduced changes in their classes. The researchers observed five class sessions of each teacher, assessed them with the same tool and each teacher-researcher pair conversed and reflected on the classes in five meetings throughout the semester. The results show that, in spite of the fact that there were important differences between teachers, the EVALOE - Decision Support System (EVALOE-SSD) is a useful tool that facilitates self-assessment, decision-making and the introduction of changes in the classes in order to promote the development of communicative and linguistic competence in the students. The analysis identified elements that can be improved and that will be considered during the review of the tool.

References

Arnott, D. & Pervan, G. (2016). A critical analysis of decision support systems research. En: Willcocks, L.P., Sauer C., & Lacity, M.C. (Eds.). Formulating Research Methods for Information Systems (127-168). London: Palgrave Macmillan.

Bornstein, M. H. (Ed.) (1989). Maternal responsiveness: Characteristics and consequences. San Francisco: Jossey-Bass.

Bronfenbrenner, U. (1987). La ecología del desarrollo humano. Barcelona: Paidós.

Bruner, J. (1983). Child’s talk: learning to use language. Nueva York: Norton

Burke-Johnson, R., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a Definition of Mixed Methods Research. Journal of Mixed Methods Research, 1(2), 112-133

del Río, M.J. & Gràcia, M. (1996). Una aproximación al análisis de los intercambios comunicativos y lingüísticos entre niños pequeños y adultos. Infancia y Aprendizaje, 75, 3-20

Eom, S. & Kim, E. (2006). A survey of Decision Support System Applications (1995-2001). The Journal of the operational Research Society, 57(11), 1264-1278

Farrell, T. (2007). Reflective languaje teaching. From research to practice. London: The Tower Building.

Generalitat de Catalunya. Legistative Decret [Decret legislatiu 142/2007. 26 de juny de 2007].

Generalitat de Catalunya. Law [Llei 12/2009. 10 de juliol de 2009].

Gómez, V. (2008). La práctica reflexiva como estrategia de autoevaluación de las prácticas de enseñanza en los profesores en servicio. Revista de Pensamiento Educativo, 43(2), 271-283.

Gràcia, M. (2003). Comunicación y lenguaje en primeras edades. Intervención con familias. Lleida: Milenio.

Gràcia, M., Ausenjo, R., & Porras, M. (2010). Intervención temprana en comunicación y lenguaje: colaboración con las educadoras y familias de dos niños. Revista de Logopedia, Foniatría y Audiología, 30(4), 186-195.

Gràcia, M., Galván-Bovaira, M.J., Vilaseca, R., Rivero, M., & Sánchez-Cano, M. (2012). El cambio conceptual de dos maestras en relación con la enseñanza y el aprendizaje de la lengua oral a través de un asesoramiento: un estudio de casos. Revista de Logopedia, Foniatría y Audiología, 32(4), 179-189.

Gràcia, M. (coord.), Galván-Bovaira, M. J., Sánchez-Cano, M., Vega, F., Vilaseca, R., & Rivero, M. (2015). Valoración de la enseñanza de la lengua oral. Escala EVALOE. Barcelona: Graó.

Gràcia, M., Benítez, P., Vega, F., & Domeniconi, C. (2015). Escala de Valoración de la Enseñanza del Lenguaje Oral en contexto Escolar: adaptación para su uso en educación especial. Revista de Logopedia, Foniatría y Audiología, 35, 84-94.

Gràcia, M., Vega, F., & Galván-Bovaira, M. J. (2015). Developing and testing EVALOE: a tool for assessing spoken language teaching and learning in the classroom. Child Language Teaching Therapy, 31(3), 287-304.

Gràcia, M., Galván-Bovaira, M. J., & Sánchez-Cano, M. (2017). Análisis de las líneas de investigación y actuación en la enseñanza y el aprendizaje del lenguaje oral en contexto escolar. Revista Española de Lingüística Aplicada, 30(1), 188-209.

Gregg, D. (2009). Developing a collective intelligence application for special education. Decision Support Systems, 47, 455-465.

Harms T., Clifford, R. M., & Cryer, D. (1998). Early Childhood Environment Rating Scale, Revised Edition. New York: Teachers College Press.

Jones, D. (2017). Talking about talk: reviewing oracy in English primary education. Early Child Development and Care, 187, 3-4, 498-508.

Kalay, P. & Chen, D. (2002). Integrating a Decision Support System into a School. Journal of Research on Technology in Education, 34(4), 435-452.

Kivijärvi, H. (1997). A Substance-Theory-Oriented Approach to the Implementation of Organizational DSS. Decision Support Systems, 20(3), 215-241.

Korthagen, F. (2011). Making teacher education relevant for practice. The pedagogy of realistic teacher education. Orbis Scholae, 5(2), 31-50

Latorre, A. (2003). La investigación-acción: Conocer y cambiar la práctica educativa. Barcelona: Graó.

Marinac, J. V., Woodyatt, G. C., & Ozanne, A. E. (2008). Investigating adult language input and young children's responses in naturalistic environments: An Observational Framework. Child Language Teaching and Therapy, 24(3), 265-284.

Marshall, J. & Lewis, E. (2014). ‘It’s the way you talk to them.’ The child’s environment: early years practitioners’ perceptions of its influence on speech and language development, its assessment and environment targeted interventions. Child Language Teaching and Therapy, 30, 337-352.

Riba, C. (2009). Mètodes d’investigació qualitativa. Universitat Oberta de Catalunya: Barcelona.

Sadahiro, Y. & Sadahiro, S. (2012). A decision support method for school relocation planning. International Journal of Urban Sciences, 16(2), 125-141.

Saviani, D. (2009). Formação de professores: aspectos históricos e teóricos do problema no contexto brasileiro. Revista Brasileira de Educação, 14(40), 143-155.

Shön, D.A. (1983). The Reflective Practitioner: How professionals think in action. New York: Basic Books.

Silver, M. S. (1991). Systems that support decision makers. New York: Wiley.

Vega, F., Gràcia, M., Domeniconi, C., & Benítez, P. (2017). Valoración de la enseñanza de la lengua oral en el aula: uso de la herramienta EVALOE en Brasil. Revista Ibero-Americana de Estudos em Educação, 12(2), 1085-1103.

Vigotsky, L. S. (1981). Pensamiento y lenguaje: teoría del desarrollo cultural de las funciones psíquicas. Buenos Aires: La Pléyade.

Xu, D. & Wang, H. (2006). Intelligent agent supported personalization for virtual learning environments. Decision Suppor

Published
2019-12-09
How to Cite
Gràcia, M., Amado, L., Jarque, S., Bitencourt, D., Vega, F., & Riba, C. (2019). EVALOE-DSS as a self-assessment and decision-making tool on the teaching of oral language in a school context: results of a pilot study. Multidisciplinary Journal of School Education, 8(1 (15). https://doi.org/10.35765/mjse.2019.0815.05

Most read articles by the same author(s)