Mapping the Knowledge Structure of Students with Intellectual Disabilities Through SOLO Taxonomy-Based Automated Assessment
DOI:
https://doi.org/10.6000/2292-2598.2026.14.01.2Keywords:
Automated assessment, inclusive education, intellectual disabilities, mixed-methods, SOLO taxonomyAbstract
Background: Mapping students with intellectual disabilities' (ID) knowledge structures is a critical challenge in inclusive education. Traditional assessments often fail to capture the nuanced cognitive development of this population. This limits teachers’ ability to design differentiated interventions. This study aimed to develop and test a SOLO Taxonomy-based Automated Assessment (SOLO-AA) system tailored for students with mild to moderate intellectual disabilities. It also examines its effectiveness in mapping hierarchical knowledge structures.
Method: An exploratory sequential mixed-methods design was used. In the qualitative phase, in-depth interviews with six special education teachers and analysis of lesson plans revealed linguistic limitations, fragmented knowledge, and a reliance on visual and contextual learning. These findings informed the design of a visual-interactive assessment system. In the quantitative phase, SOLO-AA was piloted with 30 students aged 11-15 years. Content validity was evaluated using Aiken’s V. Reliability was assessed with KR-20 and Rasch modeling.
Result: Content validity reached a score of 0.89 (highly valid), and KR-20 reliability was 0.82 (highly reliable). Most students were at the unistructural (36%) and multi-structural (30%) levels. Fewer reached the relational level (15%), and only 3% reached the extended abstract level. Rasch analysis showed person reliability of 0.79 and item reliability of 0.91. This indicates instrument stability and appropriate item difficulty for this population. Visual-based items were significantly easier. Tasks requiring concept integration were more challenging.
Conclusion: SOLO-AA provides a fine-grained mapping of students’ knowledge structures, moving beyond binary judgments. It helps teachers design differentiated instruction, improves diagnostic precision, and offers a scalable AI-assisted solution for inclusive education. This study links SOLO-AA with adaptive automated assessments and shows its utility in special education. Future research should include diverse ID populations, employ longitudinal designs, and integrate culturally relevant content to deepen contextual meaning.
References
Azatyan T, Alaverdyan A. Children with intellectual disabilities: challenges in education. Armenian J Spec Educ 2020; 4(1): 77-85. DOI: https://doi.org/10.24234/se.2020.2.2.236
Liang F, Li P. Characteristics of cognitive in children with learning difficulties. Transl Neurosci 2019; 10(1): 141-146. DOI: https://doi.org/10.1515/tnsci-2019-0024
Nugraha AK, Mumpuniarti M. Cognitive development of mild intellectual disability for vocational training. In: Proc; 2019. Vol. 296. p. 61-67. DOI: https://doi.org/10.2991/icsie-18.2019.12
Azmi HN, Primana L. Maximizing potential: 5W+1H reading comprehension strategy for student with moderate intellectual disability. J Paedagogy 2024; 11(4): 707. DOI: https://doi.org/10.33394/jp.v11i4.12877
Klefbeck K. Implementing assessment protocols in compulsory school for students with intellectual disabilities: challenges and opportunities for teachers. Int J Lesson Learn Stud 2024; 13(5): 76-91. DOI: https://doi.org/10.1108/IJLLS-04-2024-0075
Ratnengsih E, Nurihsan J. Mathematics teaching-learning for students with intellectual disabilities: systematic literature review 2022.
Masood M. Systematic review of revised Bloom taxonomy, SOLO taxonomy and Webb’s depth of knowledge (DOK) in assessing students 2016. Available from: https://www.researchgate.net/publication
Dharmasaroja P. The use of SOLO taxonomy in medical education training for medical teachers. Ramathibodi Med J 2023; 46(2): 54-63. DOI: https://doi.org/10.33165/rmj.2023.46.2.262412
Aisami RS. Learning styles and visual literacy for learning and performance. Procedia Soc Behav Sci 2015; 176: 538-545. DOI: https://doi.org/10.1016/j.sbspro.2015.01.508
Lappa CS, Mantzikos CN. Teaching individuals with Down syndrome and moderate or severe intellectual disability: an intervention programme for discovering and understanding the environment. Int J Pedagogy Teach Educ 2021; 5(2): 66. DOI: https://doi.org/10.20961/ijpte.v5i1.54526
Caniglia J, Meadows M. An application of the SOLO taxonomy to classify strategies used by pre-service teachers to solve one-question problems. Aust J Teach Educ 2018; 43(9): 75-89. DOI: https://doi.org/10.14221/ajte.2018v43n9.5
Suryani NY, Syahbani MH. Gamification and SOLO taxonomy: a strategy to promote active engagement and discipline in English language learning. Eng Rev J Engl Educ 2023; 11(3): 777-786. DOI: https://doi.org/10.25134/erjee.v11i3.8544
Al Afnan MA. Taxonomy of educational objectives: teaching, learning, and assessing in the information and artificial intelligence era. J Curric Teach 2024; 13(4): 173-191. DOI: https://doi.org/10.5430/jct.v13n4p173
Williams T. The effect of constant time delay and sentence frames on correct word selection for sentences constructed using technology-aided instruction during a story-based lesson 2022. Available from: https://dc.etsu.edu/cgi/viewcontent.cgi?a
Horn AL, Roitsch J, Murphy KA. Constant time delay to teach reading to students with intellectual disabilities and autism: a review. Int J Dev Disabil 2023; 69(2): 123-133. DOI: https://doi.org/10.1080/20473869.2021.1907138
Mukuka A, Balimuttajjo S, Mutarutinya V. Applying the SOLO taxonomy in assessing and fostering students’ mathematical problem-solving abilities. In: Proc 28th Annu Conf South Afr Assoc Res Math Sci Technol Educ; 2020. p. 104-112. Available from: https://www.researchgate.net/publication/338778457_APPLYING_THE_SOLO_TAXONOMY_IN_ASSESSING_AND_FOSTERING_STUDENTS
Yuanita P, Maimunah M, Kartini K, Arif N. Analysis of SOLO taxonomy-based test instruments in approaching the Merdeka curriculum. JRAMathEdu (J Res Adv Math Educ) 2023; 8(1): 12-29. DOI: https://doi.org/10.23917/jramathedu.v8i1.1270
Rembach L, Dison L. Transforming taxonomies into rubrics: using SOLO in social science and inclusive education. Perspect Educ 2016; 34(1): 68-83. DOI: https://doi.org/10.38140/pie.v34i1.1944
Çetin B, Ilhan M. An analysis of rater severity and leniency in open-ended mathematic questions rated through standard rubrics and rubrics based on the SOLO taxonomy. Egit Bilim 2017; 42(189): 217-247. DOI: https://doi.org/10.15390/EB.2017.5082
Chubko N, Morris JE, McKinnon DH, Slater EV, Lummis GW. SOLO taxonomy as EFL students’ disciplinary literacy evaluation tool in technology-enhanced integrated astronomy course. Lang Test Asia 2019; 9(1): 1-6. DOI: https://doi.org/10.1186/s40468-019-0095-6
Shrestha M, Roffey C. An alternative to traditional assessment: the debate showcase. J Educ Res 2020; 8(2): 5-31. DOI: https://doi.org/10.3126/jer.v8i2.22888
Fitriyah L. The use of alternative assessment for undergraduate students. Discovery (J Ilmu Pengetah) 2021; 6(2): 66-75. DOI: https://doi.org/10.33752/discovery.v6i2.1794
Adeoye MA, Prastikawati EF, Riwayatiningsih R. Beyond traditional testing: exploring the efficacy of adaptive assessments in shaping future learners. J Nonform Educ 2025; 11(1): 153-169. DOI: https://doi.org/10.15294/jone.v11i1.19934
UNESCO. Inclusive education: a global agenda for equality and quality. Paris: UNESCO Publishing; 2020.
Vries H. An integrated approach for understanding health behavior: the I-Change model as an example. Psychol Behav Sci Int J 2017; 2(2). DOI: https://doi.org/10.19080/PBSIJ.2017.02.555585
Jafer M, Crutzen R, Ibrahim A, Moafa I, Zaylaee H, Ajeely M, et al. Using the exploratory sequential mixed methods design to investigate dental patients’ perceptions and needs concerning oral cancer information, examination, prevention and behavior. Int J Environ Res Public Health 2021; 18(14). DOI: https://doi.org/10.3390/ijerph18147562
Shiyanbola OO, Rao D, Bolt D, Brown C, Zhang M, Ward E. Using an exploratory sequential mixed methods design to adapt an illness perception questionnaire for African Americans with diabetes: the mixed data integration process. Health Psychol Behav Med 2021; 9(1): 796-817. DOI: https://doi.org/10.1080/21642850.2021.1976650
Sirodjovna IO, Abdumalikovna AZ. The role of phonetic rhythmic methods in developing speech skills in hearing-impaired children. ASEAN J Sci Eng Educ 2025; 4(3): 223-230. DOI: https://doi.org/10.17509/ajsee.v4i3.82473
Khoirurroji’in A, HJ, Yanti F, Hidayatullah K, Wijaya MR, Setiawan AH. The role of Roudlotur Ridwan Islamic boarding school in empowerment of Islamic communities through life skills in the child social welfare institution (CSWI) program in East Lampung district. In: Proc 1st UMGESHIC Int Semin Health Soc Sci Humanit (UMGESHIC-ISHSSH); 2021. p. 585. DOI: https://doi.org/10.2991/assehr.k.211020.077
Puspitaloka VA, Putro KZ, Rukmana T, Elvia F. The use of visual learning media in the development optimization of children with mild mental retardation. JOYCED J Early Child Educ 2022; 2(2): 147-155. DOI: https://doi.org/10.14421/joyced.2022.22-05
Katona B, Venkataragavan J, Nina E, Ulrika B, Björn O. Use of visual learning media to increase student learning motivation. World Psychol 2023; 1(3): 89-105. DOI: https://doi.org/10.55849/wp.v1i3.381
Kurnia IR, Rifqia MW, Pratomo IFC, Riansyah TR. Penggunaan media pembelajaran visual bagi anak tunagrahita: observasi dalam kegiatan belajar di PKBM Sehati. Didaktik J Ilm PGSD FKIP Univ Mandiri 2024; 10(4): 231-241.
Putri HE, Suwangsih E, Rahayu P, Nikawanti G, Enzelina E, Wahyudy MA. Influence of concrete-pictorial-abstract (CPA) approach on the enhancement of primary school students’ mathematical reasoning ability. Mimb Sekol Dasar 2020; 7(1): 119-132. DOI: https://doi.org/10.17509/mimbar-sd.v7i1.22574
Yıldırım HH, Karabulut HA. The effectiveness of concrete-pictorial-abstract learning strategy in teaching mixtures of science subjects to students with intellectual disabilities. Mimb Sekol Dasar 2023; 10(1): 240-252. DOI: https://doi.org/10.53400/mimbar-sd.v10i1.53231
Sello L, Maphutha K, Paul M. Use of concrete-pictorial-abstract approach to enhance learners’ conceptual understanding of fractions. Edumatica J Pendidik Mat 2024; 14(3): 186-198. DOI: https://doi.org/10.22437/edumatica.v14i3.37168
Yıldırım HH, Yıkmış A. The effectiveness of concrete-representational-abstract instruction strategies in the instruction of fractions to students with learning disabilities. Eur J Spec Educ Res 2022; 8(3). DOI: https://doi.org/10.46827/ejse.v8i3.4363
Memarian B, Doleck T. A review of assessment for learning with artificial intelligence. Comput Hum Behav Artif Hum 2024; 2(1): 100040. DOI: https://doi.org/10.1016/j.chbah.2023.100040
Sibley L, Lachner A, Plicht C, Fabian A, Backfisch I, Scheiter K, et al. Feasibility of adaptive teaching with technology: which implementation conditions matter. Comput Educ 2024; 219: 105108. DOI: https://doi.org/10.1016/j.compedu.2024.105108
Kaya S, Yildiz NG. Using the concrete-representational-abstract sequence to teach math skills to a student with autism spectrum disorder in a general education classroom. Int J Dev Disabil 2024; 70(8): 1398-1409. DOI: https://doi.org/10.1080/20473869.2023.2180539
Park JY, Park EY. The Rasch analysis of Rosenberg self-esteem scale in individuals with intellectual disabilities. Front Psychol 2019; 10: 1-10. DOI: https://doi.org/10.3389/fpsyg.2019.01992
Widiana HS, Urbayatun S, Azizah PN. Psychometric properties of the Rosenberg self-esteem scale: a specific application to people with diabetes mellitus. J Educ Health Community Psychol 2025; 14(2): 619-628. DOI: https://doi.org/10.12928/jehcp.vi.30991
Tassé MJ, Schalock RL, Balboni G, Spreat S, Navas P. Validity and reliability of the diagnostic adaptive behaviour scale. J Intellect Disabil Res 2016. DOI: https://doi.org/10.1037/t52454-000
Selau T, Silva MA, Mendonça Filho EJ, Bandeira DR. Evidence of validity and reliability of the adaptive functioning scale for intellectual disability (EFA-DI). Psicol Reflex Crit 2020; 33(1). DOI: https://doi.org/10.1186/s41155-020-00164-7
Sheptian R, Ocy DR, Triana DD, Wahyuni LDU. Developing a validated essay-based assessment instrument to measure science literacy in energy topics. J Indones Stud Assess Eval 2024; 10(2): 88-100. DOI: https://doi.org/10.21009/jisae.v10i2.50762
Kim J, Gray JA. Measuring palliative care self-efficacy of intellectual and developmental disability staff using Rasch models. Palliat Support Care 2024; 22(1): 146-154. DOI: https://doi.org/10.1017/S1478951522001833
Downloads
Published
How to Cite
Issue
Section
