Work-In-Progress: Investigate Eye-Tracking Metrics and Effectiveness of Visual Learning Aids in Online Learning Environments for Students With Learning Disabilities Using Machine Learning

Authors

  • Yuexin Liu Texas A&M University
  • Wei Lu Texas A&M University
  • Amir Tofighi Zavareh Texas A&M University
  • Ben Zoghi Texas A&M University

DOI:

https://doi.org/10.33423/jhetp.v24i9.7220

Keywords:

higher education, philosophy of engineering education, K-12, STEM, factor analysis, data correlation

Abstract

This Work-In-Progress study proposes a novel approach to explore the learning behaviors of students with learning disabilities in online learning environments by investigating eye-tracking metrics and effectiveness of visual learning aids. It builds on previous research that suggests that students with learning disabilities often face difficulties in online learning environments due to the lack of visual cues and their limited ability to interact with the learning material. The use of machine learning to analyze eye-tracking data and visual learning aids can provide insights into how students with learning disability interact with online learning materials, with the goal of improving the learning outcomes as well as informing the design of constructive teaching strategies and seeking to expand this research to the online learning context

References

Bastanlar, Y., & Ozuysal, M. (2014). Introduction to machine learning. Methods Mol Biol, 1107, 105–128. https://doi.org/10.1007/978-1-62703-748-8_7

Burzykowski, T., Rousseau, A.J., Geubbelmans, M., & Valkenborg, D. (2023). Introduction to machine learning. Am J Orthod Dentofacial Orthop, 163(5), 732–734. https://doi.org/10.1016/j.ajodo.2023.02.005

Cerezo, R., Fernandez, E., Gomez, C., Sanchez-Santillan, M., Taub, M., & Azevedo, R. (2020). Multimodal protocol for assessing metacognition and self-regulation in adults with learning difficulties. J Vis Exp, (163). https://doi.org/10.3791/60331

Dawson, G. (2008). Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder. Development and Psychopathology, 20(3), 775–803.

Diard, J., Rynik, V., & Lorenceau, J. (2013). A Bayesian computational model for online character recognition and disability assessment during cursive eye writing. Front Psychol, 4, 843. https://doi.org/10.3389/fpsyg.2013.00843

Eslami, T., Mirjalili, V., Fong, A., Laird, A.R., & Saeed, F. (2019). ASD-DiagNet: A hybrid learning approach for detection of autism spectrum disorder using fMRI data. Front Neuroinform, 13, 70. https://doi.org/10.3389/fninf.2019.00070

Findlay, J.M. (1997). Saccade target selection during visual search. Vision Research, 37(5), 617–631.

Frazier, M. (2016). Dyslexia: Perspectives, challenges and treatment options. Nova Biomedical.

Glazzard, J. (2010). The impact of dyslexia on pupils’ self‐esteem. Support for Learning, 25(2), 63–69.

Goodfellow, I.J., Courville, A., & Bengio, Y. (2013). Scaling up spike-and-slab models for unsupervised feature learning. IEEE Trans Pattern Anal Mach Intell, 35(8), 1902–1914. https://doi.org/10.1109/TPAMI.2012.273

Handler, S.M., & Fierson, W. (2011). Joint technical report–learning disabilities. Dyslexia, and Vision. Pediatrics, 127(3), e818–e856.

Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. OUP Oxford.

Huang, J.-H., & Chan, Y.-S. (2020). Saccade eye movement in children with attention deficit hyperactivity disorder. Nordic Journal of Psychiatry, 74(1), 16–22.

Jothi Prabha, A., & Bhargavi, R. (2022). Prediction of dyslexia from eye movements using machine learning. IETE Journal of Research, 68(2), 814–823.

Klein, C., Fischer, B., Fischer, B., & Hartnegg, K. (2002). Effects of methylphenidate on saccadic responses in patients with ADHD. Experimental Brain Research, 145, 121–125.

Klein, C., Rauh, R., & Biscaldi, M. (2010). Cognitive correlates of anti-saccade task performance. Experimental Brain Research, 203, 759–764.

Lee, J., Grizenko, N., Bhat, V., Sengupta, S., Polotskaia, A., & Joober, R. (2011). Relation between therapeutic response and side effects induced by methylphenidate as observed by parents and teachers of children with ADHD. BMC Psychiatry, 11, 1–7.

Liu, Y., Zou, Z., Tsang, A.C.H., Pak, O.S., & Young, Y.N. (2021). Mechanical rotation at low Reynolds number via reinforcement learning. Physics of Fluids, 33(6).

Liu, Y., Lu, W., Zavareh, A.T., & Zoghi, B. (2023, October). Work-In-Progress: Investigate Eye-Tracking Metrics and Effectiveness of Visual Learning Aids in Online Learning Environments for Students with Learning Disabilities Using Machine Learning. In 2023 IEEE Frontiers in Education Conference (FIE) (pp. 1–5). IEEE.

Loth, E., Charman, T., Mason, L., Tillmann, J., Jones, E.J., Wooldridge, C., . . . Ambrosino, S. (2017). The EU-AIMS Longitudinal European Autism Project (LEAP): Design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders. Molecular Autism, 8(1), 1–19.

Manoli, A., Liversedge, S.P., Sonuga-Barke, E.J., & Hadwin, J.A. (2021). The differential effect of anxiety and ADHD symptoms on inhibitory control and sustained attention for threat stimuli: A Go/No-Go eye-movement study. Journal of Attention Disorders, 25(13), 1919–1930.

Munoz, D.P., Armstrong, I.T., Hampton, K.A., & Moore, K.D. (2003). Altered control of visual fixation and saccadic eye movements in attention-deficit hyperactivity disorder. Journal of Neurophysiology, 90(1), 503–514.

Perera, H., Shiratuddin, M.F., & Wong, K.W. (2016). Review of the role of modern computational technologies in the detection of dyslexia. Information Science and Applications (ICISA) 2016.

Prelock, P.A. (2021). Autism spectrum disorders. The Handbook of Language and Speech Disorders, pp.129–151.

Raatikainen, P., Hautala, J., Loberg, O., Kärkkäinen, T., Leppänen, P., & Nieminen, P. (2021). Detection of developmental dyslexia with machine learning using eye movement data. Array, 12, 100087.

Rello, L., & Ballesteros, M. (2015). Detecting readers with dyslexia using machine learning with eye tracking measures. Proceedings of the 12th International Web for All Conference.

Rezaei, M., & Shahidi, M. (2020). Zero-shot learning and its applications from autonomous vehicles to COVID-19 diagnosis: A review. Intell Based Med, 3, 100005. https://doi.org/10.1016/j.ibmed.2020.100005

Shadiev, R., & Li, D. (2022). A review study on eye-tracking technology usage in immersive virtual reality learning environments. Computers & Education, 104681.

Sharma, K., Giannakos, M., & Dillenbourg, P. (2020). Eye-tracking and artificial intelligence to enhance motivation and learning. Smart Learning Environments, 7(1), 1–19.

Shinde, P.P., & Shah, S. (2018). A review of machine learning and deep learning applications. 2018 Fourth international conference on computing communication control and automation (ICCUBEA).

Sutton, R.S., & Barto, A.G. (2018). Reinforcement learning: An introduction. MIT Press.

Vellutino, F.R., Fletcher, J.M., Snowling, M.J., & Scanlon, D.M. (2004). Specific reading disability (dyslexia): What have we learned in the past four decades? Journal of Child Psychology and Psychiatry, 45(1), 2–40.

Wang, C.A., Brien, D.C., & Munoz, D.P. (2015). Pupil size reveals preparatory processes in the generation of pro‐saccades and anti‐saccades. European Journal of Neuroscience, 41(8), 1102–1110.

Downloads

Published

2024-09-11

How to Cite

Liu, Y., Lu, W., Zavareh, A. T., & Zoghi, B. (2024). Work-In-Progress: Investigate Eye-Tracking Metrics and Effectiveness of Visual Learning Aids in Online Learning Environments for Students With Learning Disabilities Using Machine Learning. Journal of Higher Education Theory and Practice, 24(9). https://doi.org/10.33423/jhetp.v24i9.7220

Issue

Section

Articles