The Evolution of Four-Tier Diagnostic Tests in Physics Education: A Systematic Literature Review
This review examines Four-Tier Diagnostic Tests (FTDTs) in physics education, focusing on purposes, designs, models, scoring, measurement evidence, administration modes, and conceptual-change roles. Following PRISMA, Scopus and ERIC were searched for empirical studies published between 2021 and 2025. The final corpus comprised 23 studies: 14 journal articles and nine conference papers. Data were analyzed using descriptive statistics and framework-based narrative synthesis. Eleven studies used classical FTDTs, seven used response-enhanced FTDTs, and five used analytically advanced FTDTs. Most retained the answer–confidence–reason–confidence structure. In contrast, others added open or semi-open reasoning, scaled confidence, mental-model analysis, Rasch or Partial Credit Model scoring, and cognitive diagnostic modeling. Rule-based categorical diagnosis was the most common scoring approach. Among nine development studies, content review and reliability were common, but classification accuracy, fairness, and cross-context stability were limited. Research focused mainly on senior high school, especially mechanics and fluids. Paper-based administration was the most common single mode, although digital formats were also common. FTDTs primarily supported diagnostic profiling and intervention evaluation, whereas fewer studies examined patterns of conceptual change. No study clearly used individual profiles to adapt instruction. FTDT research has progressed toward richer responses, advanced scoring, and conceptual-change evaluation. Future studies should strengthen measurement evidence, standardize scoring, expand cross-context validation, and develop digital systems that link diagnosis to targeted remediation, monitoring, and sustained instructional support.
Keywords: four-tier diagnostic test, physics education, misconceptions, diagnostic assessment, conceptual change.
Adimayuda, R., Suhandi, A., Samsudin, A., Suhendi, E., Setiawan, A., & Fratiwi, N. J. (2025). Breaking Misconceptions: Technology-Integrated MORE Model for Meaningful Learning of Momentum and Impulse. Online Learning In Educational Research, 5(1), 25–40. https://doi.org/10.58524/oler.v5i1.606
Allen, M. (2014). Misconceptions in Primary Science. McGraw-Hill Education.
Astuti, I. A. D., Bhakti, Y. B., & Prasetya, R. (2023). Android-based 4-tier physics test app to identify student misconception profiles. International Journal of Evaluation and Research in Education, 12(3), 1356–1363. https://doi.org/10.11591/ijere.v12i3.25536
Astuti, I. A. D., Bhakti, Y. B., Prasetya, R., & Zulherman. (2023). Android-based 4-tier physics test app to identify student misconception profiles. International Journal of Evaluation and Research in Education, 12(3), 1356–1363. https://doi.org/10.11591/ijere.v12i3.25536
Azizah, S. N., Akhsan, H., Muslim, M., & Ariska, M. (2022). Analysis of college students misconceptions in astronomy using four-tier test. Journal of Physics: Conference Series, 2165(1). https://doi.org/10.1088/1742-6596/2165/1/012004
Banda, H. J., & Nzabahimana, J. (2023). The Impact of Physics Education Technology (PhET) Interactive Simulation-Based Learning on Motivation and Academic Achievement Among Malawian Physics Students. Journal of Science Education and Technology, 32(1), 127–141. https://doi.org/10.1007/s10956-022-10010-3
Bessas, N., Tzanaki, E., Vavougios, D., & Plagianakos, V. P. (2024). Diagnosing students’ misconception in Hydrostatic Pressure through a 4-tier test. Heliyon, 10(23). https://doi.org/10.1016/j.heliyon.2024.e40425
Brown, D. E. (1992). Using examples and analogies to remediate misconceptions in physics: Factors influencing conceptual change. Journal of Research in Science Teaching, 29(1), 17–34. https://doi.org/10.1002/tea.3660290104
Caleon, I. S., & Subramaniam, R. (2010). Do Students Know What They Know and What They Don’t Know? Using a Four-Tier Diagnostic Test to Assess the Nature of Students’ Alternative Conceptions. Research in Science Education, 40(3), 313–337. https://doi.org/10.1007/s11165-009-9122-4
Çelikkanlı, N. Ö., & Kızılcık, H. Ş. (2022). A review of studies about four-tier diagnostic tests in physics education. Journal of Turkish Science Education, 19(4), 1291–1311. https://doi.org/10.36681/tused.2022.175
Chi, M. T. H., Slotta, J. D., & De Leeuw, N. (1994). From things to processes: A theory of conceptual change for learning science concepts. Learning and Instruction, 4(1), 27–43. https://doi.org/10.1016/0959-4752(94)90017-5
Clement, J. (1982). Students’ preconceptions in introductory mechanics. American Journal of Physics, 50(1), 66–71. https://doi.org/10.1119/1.12989
Desstya, A., Sayekti, I. C., Abduh, M., & Sukartono, S. (2025). Development of a four-tier diagnostic test for misconceptions in natural science of primary school pupils. Journal of Turkish Science Education, 22(2), 338–353. https://doi.org/10.36681/tused.2025.017
Diani, R., Alfin, J., Anggraeni, Y. M., Mustari, M., & Fujiani, D. (2019). Four-Tier Diagnostic Test With Certainty of Response Index on The Concepts of Fluid. Journal of Physics: Conference Series, 1155, 012078. https://doi.org/10.1088/1742-6596/1155/1/012078
diSessa, A. A. (1993). Toward an Epistemology of Physics. Cognition and Instruction, 10(2–3), 105–225. https://doi.org/10.1080/07370008.1985.9649008
Duit, R., & Treagust, D. F. (2003). Conceptual change: A powerful framework for improving science teaching and learning. International Journal of Science Education, 25(6), 671–688. https://doi.org/10.1080/09500690305016
Espinoza, F. (2004). Enhancing mechanics learning through cognitively appropriate instruction. Physics Education, 39(2), 181–187. https://doi.org/10.1088/0031-9120/39/2/007
Fletcher, R. B., & Hattie, J. A. (2004). An examination of the psychometric properties of the physical self-description questionnaire using a polytomous item response model. Psychology of Sport and Exercise, 5(4), 423–446. https://doi.org/10.1016/S1469-0292(03)00036-0
Fongsamut, K., Tanasittikosol, M., & Phaksunchai, M. (2023). Effectiveness of the simulation-based learning (SBL) assisted with scaffolding approach to address students’ misconceptions about projectile motion. Physics Education, 58(2), 25002. https://doi.org/10.1088/1361-6552/aca57d
Fratiwi, N. J., Kaniawati, I., Suhendi, E., Suyana, I., & Samsudin, A. (2017). The transformation of two-tier test into four tier test on Newton’s laws concepts. AIP Conference Proceedings, 1848, 50011.
Graham, T., Berry, J., & Rowlands, S. (2013). Are ‘misconceptions’ or alternative frameworks of force and motion spontaneous or formed prior to instruction? International Journal of Mathematical Education in Science and Technology, 44(1), 84–103. https://doi.org/10.1080/0020739X.2012.703333
Guerra-Reyes, F., Guerra-Dávila, E., Naranjo-Toro, M., Basantes-Andrade, A., & Guevara-Betancourt, S. (2024). Misconceptions in the Learning of Natural Sciences: A Systematic Review. Education Sciences, 14(5), 497. https://doi.org/10.3390/educsci14050497
Hasan, S., Bagayoko, D., & Kelley, E. L. (1999). Misconceptions and the Certainty of Response Index (CRI). Physics Education, 34(5), 294–299. https://doi.org/10.1088/0031-9120/34/5/304
Hynd, C. R., McWhorter, J. Y., Phares, V. L., & Suttles, C. W. (1994). The role of instructional variables in conceptual change in high school physics topics. Journal of Research in Science Teaching, 31(9), 933–946. https://doi.org/10.1002/tea.3660310908
Isra, R. A., & Mufit, F. (2023). Students’ conceptual understanding and causes of misconceptions on Newton’s Law. International Journal of Evaluation and Research in Education, 12(4), 1914–1924. https://doi.org/10.11591/ijere.v12i4.25568
Istiyono, E., Fenditasari, K., Ayub, M. R. S., Saepuzaman, D., & Dwandaru, W. S. B. (2024). An eight-category partial credit model as very appropriate for four-tier diagnostic test scoring in physics learning. 020013. https://doi.org/10.1063/5.0133862
Istiyono, E., Sunu Brams Dwandaru, W., Fenditasari, K., Ayub, M. R. S. S. N., & Saepuzaman, D. (2023). The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education. European Journal of Educational Research, 12(1), 371–385. https://doi.org/10.12973/eu-jer.12.1.371
Jung, J. (2020). Diagnosing Causes of Pre-Service Literature Teachers’ Misconceptions on the Narrator and Focalizer Using a Two-Tier Test. Education Sciences, 10(4), 104. https://doi.org/10.3390/educsci10040104
Jurāne-Brēmane, A. (2023). Digital Assessment in Technology-Enriched Education: Thematic Review. Education Sciences, 13(5), 522. https://doi.org/10.3390/educsci13050522
Kaddouri, M., Jmad, S., Azzimani, T., Mhamdi, K., & Abbadi, Z. (2025). Transforming Assessment Practices. In Digital Tools and Platforms for Effective and Personalized Learning (hal. 155–202). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-6013-3.ch006
Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2017). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. Research in Science & Technological Education, 35(2), 238–260. https://doi.org/10.1080/02635143.2017.1310094
Kiray, S. A., & Simsek, S. (2021). Determination and Evaluation of the Science Teacher Candidates’ Misconceptions About Density by Using Four-Tier Diagnostic Test. International Journal of Science and Mathematics Education, 19(5), 935–955. https://doi.org/10.1007/s10763-020-10087-5
Koto, I., & Gusma, S. E. (2021). Using certainty response index to differentiate lack of knowledge and misconception about basic electrical concepts. Journal of Physics: Conference Series, 1731(1), 012070. https://doi.org/10.1088/1742-6596/1731/1/012070
Lampeang, N. S., Mondolang, A. H., Tumangkeng, J. V, Makahinda, T., Umboh, I., & Poluakan, C. (2021). Use of the four-tier diagnostic test with PIMCA model on learning of microscope. In T. N., M. Y., A. A.G., W. I., A. C.U., & W. A.A.D. (Ed.), Journal of Physics: Conference Series (Vol. 1968, Nomor 1). IOP Publishing Ltd. https://doi.org/10.1088/1742-6596/1968/1/012039
Liu, E., & Li, M. (2016). Enhancing science teacher professional development: Lessons from a study of misconceptions of junior secondary biology teachers. In Chinese Science Education in the 21st Century: Policy, Practice, and Research: 21 世纪中国科学教育: 政策, 实践与研究 (pp. 401–412). Dordrecht: Springer Netherlands.
Ma, W., & de la Torre, J. (2020). GDINA : An R Package for Cognitive Diagnosis Modeling. Journal of Statistical Software, 93(14). https://doi.org/10.18637/jss.v093.i14
Mahardika, A. I., Hakam, A. B., Arifuddin, M., & Halim, A. D. (2025). The Impact of Physics Modeling Learning E-Module to Overcome Misconception on Static Fluids. TEM Journal, 14(2), 1808–1819. https://doi.org/10.18421/TEM142-78
Maison, Asma, R., Doyan, A., & Saputri, L. (2022). How do additional instructions change the answer? Study of pre-service physics teachers’ misconception about buoyancy. Journal of Physics: Conference Series, 2165(1), 012048. https://doi.org/10.1088/1742-6596/2165/1/012048
Marjana, R., Achmad Samsudin, Duden Saepuzaman, & Dadi Rusdiana. (2026). Misconception in Physics Learning: A Systematic Review of the Research Trend, Misconception Profile, Diagnosis, and Remediation Strategies. Jurnal Pendidikan Fisika, 14(1), 240–262. https://doi.org/10.26618/7wdrxx78
Masters, G. N. (1982). A Rasch Model for Partial Credit Scoring. Psychometrika, 47(2), 149–174. https://doi.org/10.1007/BF02296272
Mi, S., Ye, J., Yan, L., & Bi, H. (2023). Development and validation of a conceptual survey instrument to evaluate senior high school students’ understanding of electrostatics. Physical Review Physics Education Research, 19(1), 10114. https://doi.org/10.1103/PhysRevPhysEducRes.19.010114
Munggarani, M. E., Supriyati, Y., & Astra, I. M. (2021). Identifying high school students’ misconceptions using digital four-tier diagnostic tests in distance learning. Journal of Physics: Conference Series, 2019(1). https://doi.org/10.1088/1742-6596/2019/1/012016
Mustofa, H. A., Zain, Z. A., Tsania, H., Azman, M. N. A., Marmoah, S., & Masfuah, S. (2024). Analysis of students’ conceptions based on cognitive style on newton’s law understanding. Jurnal Pendidikan IPA Indonesia, 13(2), 301–312. https://doi.org/10.15294/mx0v4952
Neumann, S., & Hopf, M. (2017). Discovering Children’s Science Associations Utilizing Drawings. In Drawing for Science Education (hal. 111–121). SensePublishers. https://doi.org/10.1007/978-94-6300-875-4_10
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, n71. https://doi.org/10.1136/bmj.n71
Pintrich, P. R., Marx, R. W., & Boyle, R. A. (1993). Beyond Cold Conceptual Change: The Role of Motivational Beliefs and Classroom Contextual Factors in the Process of Conceptual Change. Review of Educational Research, 63(2), 167–199.
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006). Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme Version, 1(1), b92.
Putranta, H., & Afifah, F. (2025). Development Of The Four-Tier Diagnostic Test To Identify Student Misconceptions In The Static Fluids Chapter. Journal on Efficiency and Responsibility in Education and Science, 18(4), 268–281. https://doi.org/10.7160/eriesj.2025.180403
Resbiantoro, G., Setiani, R., & Dwikoranto. (2022). A Review of Misconception in Physics: The Diagnosis, Causes, and Remediation. Journal of Turkish Science Education, 19(2), 403–427. https://doi.org/10.36681/tused.2022.128
Roziqin, R., Samsudin, A., Saepuzaman, D., Kaniawati, I., Iryanti, M., & Abdul Rahman, N. F. (2026). Mapping Misconceptions in Heat and Temperature: Rasch Analysis of Four-Tier Diagnostic Responses. Jurnal Pendidikan MIPA, 27(2), 867–886. https://doi.org/10.23960/jpmipa.v27i2.pp867-886
Saidi, S. S., & Siew, N. M. (2019). Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. International Electronic Journal of Mathematics Education, 14(3). https://doi.org/10.29333/iejme/5755
Samsudin, A., Afif, N. F., Nugraha, M. G., Suhandi, A., Fratiwi, N. J., Aminudin, A. H., Adimayuda, R., Linuwih, S., & Costu, B. (2021). Reconstructing Students’ Misconceptions on Work and Energy through the PDEODE*E Tasks with Think-Pair-Share. Journal of Turkish Science Education, 18(1), 118–144. https://doi.org/10.36681/tused.2021.56
Samsudin, A., Zulfikar, A., Saepuzaman, D., Suhandi, A., Aminudin, A. H., Supriyadi, S., & Coştu, B. (2024a). Correcting grade 11 students’ misconceptions of the concept of force through the conceptual change model (CCM) with PDEODE*E tasks. Journal of Turkish Science Education, 21(2), 212–231. https://doi.org/10.36681/tused.2024.012
Sarwono, S., Suhandi, A., & Samsudin, A. (2022). Remediate senior high school students’ misconception regarding the runs out battery concept using AS-CBRText. In S. A., H. L., Y. G., I. M., K. Y.F., S. A.S., & R. L. (Ed.), AIP Conference Proceedings (Vol. 2468). American Institute of Physics Inc. https://doi.org/10.1063/5.0131699
Schumacker, R. E., & Smith, E. V. (2007). A Rasch Perspective. Educational and Psychological Measurement, 67(3), 394–409. https://doi.org/10.1177/0013164406294776
Slotta, J. D., Chi, M. T. H., & Joram, E. (1995). Assessing Students’ Misclassifications of Physics Concepts: An Ontological Basis for Conceptual Change. Cognition and Instruction, 13(3), 373–400. https://doi.org/10.1207/s1532690xci1303_2
Smith, J., diSessa, A., & Roschelle, J. (1994). Misconceptions Reconceived: A Constructivist Analysis of Knowledge in Transition. The Journal of the Learning Sciences, 3, 115–163. https://doi.org/10.1207/s15327809jls0302_1
Stankov, L., & Lee, J. (2008). Confidence and cognitive test performance. Journal of Educational Psychology, 100(4), 961–976. https://doi.org/10.1037/a0012546
Surmaini, Syafe’I, I., & Diani, R. (2021). An analysis of students’ physics misconceptions in online learning using the four-tier diagnostic test with certainty of response index (CRI). IOP Conference Series: Earth and Environmental Science, 1796(1). https://doi.org/10.1088/1742-6596/1796/1/012099
Templin, J. L., & Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. In Psychological Methods (Vol. 11, Nomor 3, hal. 287–305). American Psychological Association. https://doi.org/10.1037/1082-989X.11.3.287
Treagust, D. F. (1986). Evaluating students’ misconceptions by means of diagnostic multiple-choice items. Research in Science Education, 16, 199–207.
Tumanggor, A., Supahar, Kuswanto, H., & Ringo, E. (2020). Using four-tier diagnostic test instruments to detect physics teacher candidates’ misconceptions: Case of mechanical wave concepts. Journal of Physics: Conference Series, 1440. https://doi.org/10.1088/1742-6596/1440/1/012059
Umar, F. A., Samsudin, A., Kapıcı, H. Ö., Ramalis, T. R., Aminudin, A. H., Mufidah, S. N., Kunaedi, J., Astuti, I. R. W., & Dewi, F. H. (2024). Developing Dispersion and Polarization Conceptual Inventory (DiPolCI) to Identify Students’ Mental Model. Journal of Science Learning, 7(3), 239–247. https://doi.org/10.17509/jsl.v7i3.69058
Vispoel, W. P., & Kim, H. Y. (2014). Psychometric properties for the Balanced Inventory of Desirable Responding: Dichotomous versus polytomous conventional and IRT scoring. Psychological Assessment, 26(3), 878–891. https://doi.org/10.1037/a0036430
Vosniadou, S., & Mason, L. (2012). Conceptual change induced by instruction: A complex interplay of multiple factors. In APA educational psychology handbook, Vol 2: Individual differences and cultural and contextual factors. (hal. 221–246). American Psychological Association. https://doi.org/10.1037/13274-009
Zach, H. (2005). Psychometrics properties of the questionnaire surveys: Validity, reliability and feasibility. Sociologia, 37(3), 275–291. https://www.scopus.com/inward/record.uri?eid=2-s2.0-21344472799&partnerID=40&md5=ac8a6a66a38bbf22820a3ecbd453c20d
Zain, A. Z., Samsudin, A., & Hasanah, L. (2025). Diagnostic Instrument Test of Renewable Energy Topics: Analysis of Conceptual Change Students Using the Rasch Approach. Online Learning In Educational Research (OLER), 5(2), 231–243. https://doi.org/10.58524/oler.v5i2.675
Zhai, X., Haudek, K. C., & Ma, W. (2023). Assessing Argumentation Using Machine Learning and Cognitive Diagnostic Modeling. Research in Science Education, 53(2), 405–424. https://doi.org/10.1007/s11165-022-10062-w
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.