International Electronic Journal of Mathematics Education

International Electronic Journal of Mathematics Education
Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking
APA
In-text citation: (Dröse et al., 2021)
Reference: Dröse, J., Prediger, S., Neugebauer, P., Delucchi Danhier, R., & Mertins, B. (2021). Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking. International Electronic Journal of Mathematics Education, 16(1), em0625. https://doi.org/10.29333/iejme/9674
AMA
In-text citation: (1), (2), (3), etc.
Reference: Dröse J, Prediger S, Neugebauer P, Delucchi Danhier R, Mertins B. Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking. INT ELECT J MATH ED. 2021;16(1), em0625. https://doi.org/10.29333/iejme/9674
Chicago
In-text citation: (Dröse et al., 2021)
Reference: Dröse, Jennifer, Susanne Prediger, Philipp Neugebauer, Renate Delucchi Danhier, and Barbara Mertins. "Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking". International Electronic Journal of Mathematics Education 2021 16 no. 1 (2021): em0625. https://doi.org/10.29333/iejme/9674
Harvard
In-text citation: (Dröse et al., 2021)
Reference: Dröse, J., Prediger, S., Neugebauer, P., Delucchi Danhier, R., and Mertins, B. (2021). Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking. International Electronic Journal of Mathematics Education, 16(1), em0625. https://doi.org/10.29333/iejme/9674
MLA
In-text citation: (Dröse et al., 2021)
Reference: Dröse, Jennifer et al. "Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking". International Electronic Journal of Mathematics Education, vol. 16, no. 1, 2021, em0625. https://doi.org/10.29333/iejme/9674
Vancouver
In-text citation: (1), (2), (3), etc.
Reference: Dröse J, Prediger S, Neugebauer P, Delucchi Danhier R, Mertins B. Investigating Students’ Processes of Noticing and Interpreting Syntactic Language Features in Word Problem Solving through Eye-Tracking. INT ELECT J MATH ED. 2021;16(1):em0625. https://doi.org/10.29333/iejme/9674

Abstract

Syntactic language features of word problems have often been identified by assessment studies and interview studies as potential obstacles in word problem solving. However, students’ processes of noticing and interpreting these features have only rarely been investigated in depth because noticing is hard to investigate. Eye-tracking methodology has already been shown to be a suitable methodology for analyzing noticing other word problem features, but not yet for syntactic features. The longitudinal eye-tracking study presented here analyzes fifth graders’ processes of noticing and interpreting of syntactic word problems before and after an intervention on word problem solving. Based on the eye-mind hypothesis, the study captures students’ noticing through eye-tracking, whereas interpreting can be captured by their solutions. The analysis of pre-intervention data reveals that long fixations cannot be identified with successful noticing and vice versa. But when comparing the net dwell time (i.e., the time that students look at the words indicating syntactic structures) before and after the intervention, an interesting decrease is revealed. This decrease occurs for both expected and less expected syntactic structures, regardless of the accuracy of mathematization. Meanwhile, analyzing the revisits of students indicates differences between items with more or less expected structures and correctly or incorrectly mathematized items. Methodologically, the article contributes to understanding which eye-tracking measures are relevant for capturing changes in students’ processes of noticing syntactic language features: The revisits and scan paths reveal more insights than the net dwell time.

References

  • Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14(3), 219-234. https://doi.org/10.1207/S15324818AME1403_2
  • Anderson, J., Bothell, D., & Douglass, S. (2004). Eye Movements Do Not Reflect Retrieval Processes Limits of the Eye-Mind Hypothesis. Psychological Science, 15(4), 225-231. https://doi.org/10.1111/j.0956-7976.2004.00656.x
  • Andrá, C., Lindström, P., Arzarello, F., Holmqvist, K., Robutti, O., & Sabena, C. (2013). Reading mathematics representations: an eye-tracking study. International Journal of Science and Mathematics Education, 13(2), 237-259. https://doi.org/10.1007/s10763-013-9484-y
  • Beese, M., & Gürsoy, E. (2012). Bezüge im Deutschen und im Türkischen herstellen. Sprachliche Stolpersteine beim Mathematiklernen für zweisprachige Lernende. Praxis der Mathematik in der Schule, 54(45), 34-37.
  • Beitlich, J., Obersteiner, A., & Reiss, K. (2015). How do secondary school students make use of different repre-sentation formats in heuristic worked examples? - An analysis of eye movements. In K. Beswick, T. Muir, & J. Wells (Eds.), Proceedings of PME39 (Vol. 2, pp. 97-104). Hobart: PME.
  • Bergqvist, E., Dyrvold, A., & Österholm, M. (2012). Relating Vocabulary in Mathematical Tasks to Aspects of Reading and Solving. In C. Bergsten, E. Jablonka, & M. Raman (Eds.), Evaluation and comparison of mathe-matical achievement: Dimensions and perspectives: Proceedings of MADIF 8, The Eighth Mathematics Education Research Seminar, Umea, January, 24-25, 2012 (pp. 61-70). SMDF.
  • Bialystok, E. (1986). Factors in the growth of linguistic awareness. Child Development, 57(2), 498-510. https://doi.org/10.2307/1130604
  • Boonen, A. J. H., van der Schoot, M., van Wesel, F., de Vries, M. H., & Jolles, J. (2013). What underlies successful word problem solving? - A path analysis in sixth grade students. Contemporary Educational Psychology, 38(3), 271-279. https://doi.org/10.1016/j.cedpsych.2013.05.001
  • Brimo, D., Apel, K., & Fountain, T. (2017). Examining the contributions of syntactic awareness and syntactic knowledge to reading comprehension. Journal of Research in Reading, 40(1), 57-74. https://doi.org/10.1111/1467-9817.12050
  • Cummins, D. D., Kintsch, W., Reusser, K., & Weimer, R. (1988). The role of understanding in solving word problems. Cognitive Psychology, 20(4), 405-438. https://doi.org/10.1016/0010-0285(88)90011-4
  • Daroczy, G., Wolska, M., Meurers, W. D., & Nuerk, H.-C. (2015). Word problems: a review of linguistic and nu-merical factors contributing to their difficulty. Frontiers in Psychology, 6(348), 1-13. https://doi.org/10.3389/fpsyg.2015.00348
  • Dröse, J. (2019). Textaufgaben lesen und verstehen lernen. Entwicklungsforschungsstudie zur mathematikspezifischen Leseverständnisförderung [Reading and comprehending word problems: Design research study on mathematics-specific reading comprehension]. Heidelberg: Springer Spektrum. https://doi.org/10.1007/978-3-658-27850-2
  • Dröse, J., & Prediger, S. (2020). Enhancing fifth graders’ awareness of syntactic features in mathematical word problems: A Design Research study on the variation principle. Journal für Mathematik-Didaktik, 41(2), 391-422. https://doi.org/10.1007/s13138-019-00153-z
  • Dröse, J., & Prediger, S. (2021). Identifying obstacles is not enough for everybody – Differential efficacy of an intervention fostering fifth graders’ comprehension for word problems. Studies in Educational Evaluation, 68(100953), 1–15. https://doi.org/10.1016/j.stueduc.2020.100953
  • Dröse, J., Prediger, S., & Marcus, A. (2018). Strategien zum Verstehen von Textaufgaben – Fach- und sprachintegriertes Unterrichtsmaterial in Basis- und Regelfassung. Retrieved from Open educational resources on www.sima.dzlm.de/um/5-001
  • Dröse, J., Prediger, S., Neugebauer, P., Delucchi Danhier, R., & Mertins, M. (submitted). Eye-Tracking-Studie zu Textaufgaben in Klasse 5: Syntaktische Strukturen bemerken und interpretieren bei verschiedenen Sprachprofilen. Submitted Manuscript.
  • Dyrvold, A., Bergqvist, E., & Österholm, M. (2015). Uncommon vocabulary in mathematical tasks in relation to demand of reading ability and solution frequency. Nordic Studies in Mathematics Education, 20(1), 5-31.
  • Fandrych, C. (2005a). Ordnung und Variation in Satz und Text. Wortstellung entdecken, erkunden, erproben. Fremdsprache Deutsch, 32, 5-11. https://doi.org/10.37307/j.2194-1823.2005.32.03
  • Fandrych, C. (2005b). Schauplatz: Wortstellung. Wichtige Regeln und Tendenzen. Fremdsprache Deutsch, 32, 12-18. https://doi.org/10.37307/j.2194-1823.2005.32.04
  • García, O. (2017). Critical multilingual language awareness and teacher education. In J. Cenoz, S. May & D. Gorter (Eds.), Language Awareness and Multilingualism (pp. 263-280). Cham: Springer. https://doi.org/10.1007/978-3-319-02240-6_30
  • Gu, F., Huang, R., & Gu, L. (2017). Theory and development of teaching through variation in mathematics in China. In R. Huang & Y. Li (Eds.), Teaching and learning mathematics through variation. Confucian heritage meets western theories (pp. 13-41). Rotterdam: Sense Publishers. https://doi.org/10.1007/978-94-6300-782-5_2
  • Gürsoy, E., Benholz, C., Renk, N., Prediger, S., & Büchter, A. (2013). Erlös_ Erlösung? - Sprachliche und konzeptuelle Hürden in Prüfungsaufgaben zur Mathematik [Redemption_ redemption? - Linguistic and conceptual hurdles in mathematics exam questions]. Deutsch als Zweitsprache, 13(1), 14-24.
  • Haag, N., Heppt, B., Roppelt, A., & Stanat, P. (2015). Linguistic simplification of mathematics items: Effects for language minority students in Germany. European Journal of Psychology of Education, 30(2), 145-167. https://doi.org/10.1007/s10212-014-0233-6
  • Haag, N., Heppt, B., Stanat, P., Kuhl, P., & Pant, H. A. (2013). Second language learners’ performance in mathe-matics: Disentangling the effects of academic language features. Learning and Instruction, 28, 24-34. https://doi.org/10.1016/j.learninstruc.2013.04.001
  • Halliday, M. A. K. (2004). An introduction to functional grammar. New York: Oxford University Press. https://doi.org/10.4324/9780203783771
  • Hannafin, M., Land, S., & Oliver, K. (1999). Open Learning Environments: Foundations, Methods, and Models. In C. M. Reigeluth (Ed.), Instructional-design Theories and Models (pp. 115-140). Mahwah: Lawrence Erlbaum.
  • Hegarty, M., Mayer, R. E., & Green, C. E. (1992). Comprehension of Arithmetic Word Problems: Evidence From Students’ Eye Fixations. Journal of Educational Psychology, 84(1), 76-84. https://doi.org/10.1037/0022-0663.84.1.76
  • Hegarty, M., Mayer, R. E., & Monk, C. A. (1995). Comprehension of Arithmetic Word Problems: A Comparison of Successful and Unsuccessful Problem Solvers. Journal of Educational Psychology, 87(1), 18-32. https://doi.org/10.1037/0022-0663.87.1.18
  • Huang, R., Barlow, A. T., & Prince, K. (2016). The same tasks, different learning opportunities: An analysis of two exemplary lessons in China and the U.S. from a perspective of variation. The Journal of Mathematical Behavior, 41, 141-158. https://doi.org/10.1016/j.jmathb.2015.12.001
  • Inglis, M., & Alcock, L. (2012). Expert and novice approaches to reading mathematical proofs. Journal for Re-search in Mathematics Education, 43(4), 358-390. https://doi.org/10.5951/jresematheduc.43.4.0358
  • Inhoff, A. W., & Rayner, K. (1986). Parafoveal word processing during eye fixations in reading: Effects of word frequency. Perception & Psychophysics, 40, 431-440. https://doi.org/10.3758/BF03208203
  • Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329-354. https://doi.org/10.1037/0033-295X.87.4.329
  • Kaulvers, J., Schlager, S., Isselbächer-Giese, A., & Klein, M. (2016). Entwickeln, Beraten, Unterstützen - QUA-LIS. Sprachliche Hürden in Mathematikaufgaben. Schule NRW, 07/08, 16-19.
  • Lai, M.-L., Tsai, M.-J., Yang, F.-Y., Hsu, C.-Y., Liu, T.-C., Lee, S. W.-Y., Lee, M.-H., Chiou, G.-L., Liang, J.-C., & Tsai, C.-C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90-115. https://doi.org/10.1016/j.edurev.2013.10.001
  • Leiss, D., Plath, J., & Schwippert, K. (2019). Language and Mathematics - Key factors influencing the compre-hension process in reality-based tasks. Mathematical Thinking and Learning, 21(2), 131-153. https://doi.org/10.1080/10986065.2019.1570835
  • Lenhard, W., & Schneider, W. (2006). ELFE 1-6. Ein Leseverständnistest für Erst- bis Sechstklässler. In M. Hasselhorn, H. Marx, & W. Schneider (Eds.), Deutsch Schultest. Göttingen: Hogrefe.
  • Martiniello, M. (2009). Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educational Assessment, 14(3-4), 160-179. https://doi.org/10.1080/10627190903422906
  • Marton, F., & Pang, M.F. (2006). On some necessary conditions of learning. The Journal of the Learning Sciences, 15(2), 193-2, 20. https://doi.org/10.1207/s15327809jls1502_2
  • Melzer, F. (2013). Modellierung, Diagnose und Förderung von Sprachbewusstheit in der Sekundarstufe. In S. Gailberger & F. Wietzke (Eds.), Handbuch kompetenzorientierter Deutschunterricht (pp. 300-321). Weinheim: Beltz.
  • Norqvist, M., Jonsson, B., Lithner, J., Qwillbard, T., & Holm, L. (2019). Investigating algorithmic and creative reasoning strategies by eye tracking. The Journal of Mathematical Behavior, 55, 1-14. https://doi.org/10.1016/j.jmathb.2019.03.008
  • Nortvedt, G. A. (2011). Coping strategies applied to comprehend multistep arithmetic word problems by stu-dents with above-average numeracy skills and below-average reading skills. The Journal of Mathematical Behavior, 30(3), 255-269. https://doi.org/10.1016/j.jmathb.2011.04.003
  • Obersteiner A., & Tumpek, C. (2016). Measuring fraction comparison strategies with eye-tracking. ZDM Mathematics Education, 48, 255-266. https://doi.org/10.1007/s11858-015-0742-z
  • Pang, M. F., Bao, J., & Ki, W. W. (2017). “Bianshi” and the variation theory of learning: Illustrating two frameworks of variation and invariance in the teaching of mathematics. In R. Huang & Y. Li (Eds.), Teaching and learning mathematics through variation. Confucian heritage meets western theories (pp. 43-67). Rotterdam: Sense. https://doi.org/10.1007/978-94-6300-782-5_3
  • Paulus, C. (2009). Die „Bücheraufgabe” zur Bestimmung des kulturellen Kapitals bei Grundschülern. Retrieved on 20 June 2019 from http://hdl.handle.net/20.500.11780/3344
  • Portmann-Tselikas, P. R. (2001). Sprachaufmerksamkeit und Grammatiklernen. In P. R. Portmann-Tselikas & S. Schmölzer-Eibinger (Eds.), Grammatik und Sprachaufmerksamkeit (pp. 9-48). Innsbruck, Wien, Bozen: Studien Verlag.
  • Prediger, S., & Krägeloh, N. (2015). Low achieving eighth graders learn to crack word problems: a design research project for aligning a strategic scaffolding tool to students’ mental processes. ZDM Mathematics Education, 47(6), 947–962. https://doi.org/10.1007/s11858-015-0702-7
  • Prediger, S., & Zindel, C. (2017). School Academic Language Demands for Understanding Functional Relationships: A Design Research Project on the Role of Language in Reading and Learning. EURASIA Journal of Mathematics, Science and Technology Education, 13(7b), 4157-4188. https://doi.org/10.12973/eurasia.2017.00804a
  • Prediger, S., Wilhelm, N., Büchter, A., Gürsoy, E., & Benholz, C. (2018). Language proficiency and mathematics achievement – Empirical study of language-induced obstacles in a high stakes test, the central exam ZP10. Journal für Mathematik-Didaktik, 39(Suppl. 1), 1-26. https://doi.org/10.1007/s13138-018-0126-3
  • Rayner, K., & Well, A. D. (1996). Effects of contextual constraint on eye movements in reading: A further exami-nation. Psychonomic Bulletin & Review, 3, 504-509. https://doi.org/10.3758/BF03214555
  • Rayner, K., Pollatsek, A., Ashby, J., & Clifton, C. (2012). Psychology of reading. New York: Psychology Press. https://doi.org/10.4324/9780203155158
  • Reusser, K. (1989). Vom Text zur Situation zur Gleichung. Kognitive Simulation von Sprachverständnis und Mathematisierung beim Lösen von Textaufgaben. Universität Bern: Habilitationsschrift.
  • Reusser, K. (1993). Tutoring systems and pedagogical theory: representational tools for understanding, plan-ning, and reflection in problem solving. In S. P. Lajoie & S. J. Derry (Eds.), Computers as Cognitive Tools (pp. 143-177). Mahwah: Erlbaum.
  • Reusser, K. (1997). Erwerb mathematische Kompetenzen: Literaturüberblick. In F. Weinert & A. Helmke (Eds.), Entwicklung im Grundschulalter (pp. 141-155). Weinheim: Beltz.
  • Schindler, M., & Lilienthal, A. J. (2019). Domain-specific interpretation of eye tracking data: towards a refined use of the eye-mind hypothesis for the field of geometry. Educational Studies in Mathematics, 101(1), 123-139. https://doi.org/10.1007/s10649-019-9878-z
  • Schindler, M., Lilienthal, A. J., Chadalavada, R., & Ögren, M. (2016). Creativity in the eye of the student. Refin-ing investigations of mathematical creativity using eye-tracking goggles. In C. Csíkos, A. Rausch, & J. Szitányi (Eds.), Proceedings of the 40th Conference of the International Group for the Psychology of Mathematics Education (PME) (Vol. 4, pp. 163-170). Szeged: PME.
  • Schleppegrell, M. J. (2007). The linguistic challenges of mathematics teaching and learning: a research review. Reading and Writing Quarterly, 23(2), 139-159. https://doi.org/10.1080/10573560601158461
  • Smith, M. S. (2008). Morphological and syntactic awareness in foreign/second language learning. In J. Cenoz & N.H. Hornberger (Eds.), Encyclopedia of language and education (Vol. 6, pp. 179-191). Heidelberg: Springer.
  • Solano-Flores, G. (2010). Function and Form in Research on Language and Mathematics Education. In J. Mos-chkovich (Ed.), Language and Mathematics Education: Multiple Perspectives and Directions for Research (pp. 113-149). Charlotte: Information Age.
  • Strohmaier, A. R., Lehner, M. C., Beitlich, J. T., & Reiss, K. M. (2019). Eye movements during mathematical word problem solving—global measures and individual differences. Journal für Mathematik-Didaktik, 40(2), 255-287. https://doi.org/10.1007/s13138-019-00144-0
  • Strohmaier, A. R., MacKay, K. J., Obersteiner, A., & Reiss, K. M. (2020). Eye-tracking methodology in mathemat-ics education research: A systematic literature review. Educational Studies in Mathematics, 104(2), 147-200. https://doi.org/10.1007/s10649-020-09948-1
  • Thevenot, C. (2010). Arithmetic word problem solving: evidence for the construction of a mental model. Acta Psychologica, 133(1), 90-95. https://doi.org/10.1016/j.actpsy.2009.10.004
  • van der Schoot, M., Bakker Arkema, A., Horsley, T., & van Lieshout, E. (2009). The consistency effect depends on markedness in less successful but not successful problem solvers: An eye movement study in primary school children. Contemporary Educational Psychology, 34, 58-66. https://doi.org/10.1016/j.cedpsych.2008.07.002
  • Verschaffel, L., de Corte, E., & Pauwels, A. (1992). Solving compare problems: an eye movement test of Lewis and Mayer’s Consistency Hypothesis. Journal of Educational Psychology, 84(1), 85-94. https://doi.org/10.1037/0022-0663.84.1.85
  • Verschaffel, L., Greer, B., & de Corte, E. (2000). Making sense of word problems. Lisse: Swets & Zeitlinger.
  • Wildemann, A., Akbulut, M., & Bien-Miller, L. (2016). Mehrsprachige Sprachbewusstheit zum Ende der Grundschulzeit. Vorstellung und Diskussion eines Elizitationsverfahrens. Zeitschrift für Interkulturellen Fremdsprachenunterricht, 21(2), 42-56.
  • Wolf, M. K., & Leon, S. (2009). An investigation of the language demands in content assessments for English language learners. Educational Assessment, 14(3-4), 139-159. https://doi.org/10.1080/10627190903425883
  • Wood, D., Bruner, J. S., & Ross, G. (1976). The Role of Tutoring in Problem Solving. Journal of Child Psychology and Psychiatry, 17(2), 89-100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.