EVALOE-DSS as a self-assessment and decision-making tool on the teaching of oral language in a school context: results of a pilot study
Abstract
School is a natural context for development in which the communicative strategies used by teachers when interacting with students are essential for the development of communicative and linguistic competence. The objective of this study was to construct, implement and validate a first version of a self-assessment and decision-making tool on the teaching of oral language at school. It is an adaptation of the Oral Language Assessment in the School Context Scale (Escala de Valoración de la enseñanza de la Lengua Oral en contexto Escolar-EVALOE) (Gràcia et al., 2015) based on the use of the Conversational Methodology. This is a multiple case study focusing on four teachers (1 from an ordinary school, 2 from a rural school and 1 from a special education school). For six months, the teachers self-assessed their teaching practices with the tool, made decisions to improve it, and introduced changes in their classes. The researchers observed five class sessions of each teacher, assessed them with the same tool and each teacher-researcher pair conversed and reflected on the classes in five meetings throughout the semester. The results show that, in spite of the fact that there were important differences between teachers, the EVALOE - Decision Support System (EVALOE-SSD) is a useful tool that facilitates self-assessment, decision-making and the introduction of changes in the classes in order to promote the development of communicative and linguistic competence in the students. The analysis identified elements that can be improved and that will be considered during the review of the tool.References
Arnott, D. & Pervan, G. (2016). A critical analysis of decision support systems research. En: Willcocks, L.P., Sauer C., & Lacity, M.C. (Eds.). Formulating Research Methods for Information Systems (127-168). London: Palgrave Macmillan.
Bornstein, M. H. (Ed.) (1989). Maternal responsiveness: Characteristics and consequences. San Francisco: Jossey-Bass.
Bronfenbrenner, U. (1987). La ecología del desarrollo humano. Barcelona: Paidós.
Bruner, J. (1983). Child’s talk: learning to use language. Nueva York: Norton
Burke-Johnson, R., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a Definition of Mixed Methods Research. Journal of Mixed Methods Research, 1(2), 112-133
del Río, M.J. & Gràcia, M. (1996). Una aproximación al análisis de los intercambios comunicativos y lingüísticos entre niños pequeños y adultos. Infancia y Aprendizaje, 75, 3-20
Eom, S. & Kim, E. (2006). A survey of Decision Support System Applications (1995-2001). The Journal of the operational Research Society, 57(11), 1264-1278
Farrell, T. (2007). Reflective languaje teaching. From research to practice. London: The Tower Building.
Generalitat de Catalunya. Legistative Decret [Decret legislatiu 142/2007. 26 de juny de 2007].
Generalitat de Catalunya. Law [Llei 12/2009. 10 de juliol de 2009].
Gómez, V. (2008). La práctica reflexiva como estrategia de autoevaluación de las prácticas de enseñanza en los profesores en servicio. Revista de Pensamiento Educativo, 43(2), 271-283.
Gràcia, M. (2003). Comunicación y lenguaje en primeras edades. Intervención con familias. Lleida: Milenio.
Gràcia, M., Ausenjo, R., & Porras, M. (2010). Intervención temprana en comunicación y lenguaje: colaboración con las educadoras y familias de dos niños. Revista de Logopedia, Foniatría y Audiología, 30(4), 186-195.
Gràcia, M., Galván-Bovaira, M.J., Vilaseca, R., Rivero, M., & Sánchez-Cano, M. (2012). El cambio conceptual de dos maestras en relación con la enseñanza y el aprendizaje de la lengua oral a través de un asesoramiento: un estudio de casos. Revista de Logopedia, Foniatría y Audiología, 32(4), 179-189.
Gràcia, M. (coord.), Galván-Bovaira, M. J., Sánchez-Cano, M., Vega, F., Vilaseca, R., & Rivero, M. (2015). Valoración de la enseñanza de la lengua oral. Escala EVALOE. Barcelona: Graó.
Gràcia, M., Benítez, P., Vega, F., & Domeniconi, C. (2015). Escala de Valoración de la Enseñanza del Lenguaje Oral en contexto Escolar: adaptación para su uso en educación especial. Revista de Logopedia, Foniatría y Audiología, 35, 84-94.
Gràcia, M., Vega, F., & Galván-Bovaira, M. J. (2015). Developing and testing EVALOE: a tool for assessing spoken language teaching and learning in the classroom. Child Language Teaching Therapy, 31(3), 287-304.
Gràcia, M., Galván-Bovaira, M. J., & Sánchez-Cano, M. (2017). Análisis de las líneas de investigación y actuación en la enseñanza y el aprendizaje del lenguaje oral en contexto escolar. Revista Española de Lingüística Aplicada, 30(1), 188-209.
Gregg, D. (2009). Developing a collective intelligence application for special education. Decision Support Systems, 47, 455-465.
Harms T., Clifford, R. M., & Cryer, D. (1998). Early Childhood Environment Rating Scale, Revised Edition. New York: Teachers College Press.
Jones, D. (2017). Talking about talk: reviewing oracy in English primary education. Early Child Development and Care, 187, 3-4, 498-508.
Kalay, P. & Chen, D. (2002). Integrating a Decision Support System into a School. Journal of Research on Technology in Education, 34(4), 435-452.
Kivijärvi, H. (1997). A Substance-Theory-Oriented Approach to the Implementation of Organizational DSS. Decision Support Systems, 20(3), 215-241.
Korthagen, F. (2011). Making teacher education relevant for practice. The pedagogy of realistic teacher education. Orbis Scholae, 5(2), 31-50
Latorre, A. (2003). La investigación-acción: Conocer y cambiar la práctica educativa. Barcelona: Graó.
Marinac, J. V., Woodyatt, G. C., & Ozanne, A. E. (2008). Investigating adult language input and young children's responses in naturalistic environments: An Observational Framework. Child Language Teaching and Therapy, 24(3), 265-284.
Marshall, J. & Lewis, E. (2014). ‘It’s the way you talk to them.’ The child’s environment: early years practitioners’ perceptions of its influence on speech and language development, its assessment and environment targeted interventions. Child Language Teaching and Therapy, 30, 337-352.
Riba, C. (2009). Mètodes d’investigació qualitativa. Universitat Oberta de Catalunya: Barcelona.
Sadahiro, Y. & Sadahiro, S. (2012). A decision support method for school relocation planning. International Journal of Urban Sciences, 16(2), 125-141.
Saviani, D. (2009). Formação de professores: aspectos históricos e teóricos do problema no contexto brasileiro. Revista Brasileira de Educação, 14(40), 143-155.
Shön, D.A. (1983). The Reflective Practitioner: How professionals think in action. New York: Basic Books.
Silver, M. S. (1991). Systems that support decision makers. New York: Wiley.
Vega, F., Gràcia, M., Domeniconi, C., & Benítez, P. (2017). Valoración de la enseñanza de la lengua oral en el aula: uso de la herramienta EVALOE en Brasil. Revista Ibero-Americana de Estudos em Educação, 12(2), 1085-1103.
Vigotsky, L. S. (1981). Pensamiento y lenguaje: teoría del desarrollo cultural de las funciones psíquicas. Buenos Aires: La Pléyade.
Xu, D. & Wang, H. (2006). Intelligent agent supported personalization for virtual learning environments. Decision Suppor
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
- The Author/Authors agree(s) to publish the article free of charge in Multidisciplinary Journal of School Education in English or Spanish. The Editorial Board reserves the right to shorten the texts and change the titles.
- As part of free publication mentioned in § 1, the Author/Authors agrees to make the full electronic version of their article available in the Internet.
- The Author/Authors agrees to index their article in databases at home and abroad, including abstracts and keywords as well as Author's/Authors’ affiliation in English and in other languages. The Author/Authors agrees to pass on the information mentioned above to the owners of these databases.
- The Author/Authors declares that their publication is original and does not include borrowings from other works which might cause Publisher's responsibility, does not infringe the rights of the third party and that their copyright on this publication is not limited. The Author/Authors will incur all the costs and will pay compensations which might result from the mendacity of the following statement.
- The Author/Authors declares to bear complete responsibility for the scientific reliability of the article submitted. The detailed contribution of all co-authors is defined.
- The Author/Authors declares to publish the text in the Multidisciplinary Journal of School Education under a Creative Commons Attribution-NoDerivatives 4.0 International License (CC BY-ND 4.0).
- For more than one author, please complete the Authorship Contributions and send it to the editorial office. Please indicate the specific contributions made by each author (list the authors’ initials, e.g., JKH). Please download, complete, scan and attach the file in the system during the submission process.
Authors Statement - Authorship Contributions