Design Gap Analysis of Sustainability-Oriented Biology Teaching Modules among Pre-Service Teachers Using Project-Based Learning Analytics

Eva Fadilah; Rifki Risma Munandar

doi:10.61142/esj.v4i2.360

Authors

Eva Fadilah Universitas Islam Negeri Syarif Hidayatullah Jakarta
Rifki Risma Munandar Universitas Pakuan

DOI:

https://doi.org/10.61142/esj.v4i2.360

Keywords:

Biology teaching module, Pre-service biology teachers, Project-based learning analytics, Sustainability-oriented education

Abstract

This study investigates the use of project-based learning analytics as a diagnostic approach to identify gaps between administrative completion and conceptual design quality in sustainability-oriented biology teaching modules developed by pre-service biology teachers. Participants were 63 pre-service biology teachers from two classes (5A = 30 students; 5B = 33 students), who produced 13 group teaching modules. Data included project scores, formative scores, midterm and final examination scores, project-component records, questionnaire responses, and design-gap rubric scores. The data were analyzed using descriptive statistics, comparison between administrative and conceptual components, and percentage-based design-gap analysis across curriculum alignment, assessment design, digital pedagogy, deep learning, and sustainability integration. Results showed that overall student performance was relatively good and homogeneous, with a mean final score of 81.34 and a standard deviation of 2.23. However, full administrative completion of project drafts and progress reports (100.00%) did not correspond to conceptual design quality. The final teaching modules achieved only 34.90% of the target criteria for coherent integration of module components. The largest design gap was found in sustainability integration (76.90%), followed by deep learning (69.20%), assessment design (61.50%), digital pedagogy (53.80%), and curriculum alignment (46.20%). These findings indicate that project completion does not automatically ensure coherent instructional design. This study contributes by demonstrating that project-based learning analytics can reveal hidden weaknesses in sustainability-oriented instructional design that are not captured by final grades or document completion alone. The findings highlight the need for operational rubrics, formative feedback, model modules, and explicit design scaffolding.

References

Arrieta, G. S. (2020). Assessment of the ICT integration in teaching math and science in high school: Basis for an ICT integration program. Jurnal Pendidikan MIPA, 21(1), 95–108. https://doi.org/10.23960/jpmipa/v21i1.pp95-108

Batuchina, A., Brazauskienė, E., Kesylė, K., & Melnikova, J. (2023). Preconditions for the development of the integrated learning analytics and action research model for Lithuanian general education schools: Theoretical insights and research design. Journal of Digital Pedagogy, 2(1), 8–13. https://doi.org/10.61071/JDP.2311

Bauer, M. L., O'Brien, K. M., & Kovach, A. I. (2022). Can at-risk species serve as effective conservation surrogates? Case study in northeastern US shrublands. Ecosphere, 13, Article e4081. https://doi.org/10.1002/ecs2.4081

Baumgartner, M. (2022). Professional competence(s) of physical education teachers: Terms, traditions, modelling and perspectives. German Journal of Exercise and Sport Research, 52(4), 550–557. https://doi.org/10.1007/s12662-022-00840-z

Birkett, E., Fano, E., Alonso, A., & Avina, I. (2023). Climate education policy in New York: Preparing students for a climate-altered world. Journal of Science Policy & Governance, 22(1). https://doi.org/10.38126/JSPG220102

Blosser, A. H., & Cavendish, L. M. (2023). Teaching and leading in the age of critical race theory legislation: A case of self-silencing in a school. Journal of Cases in Educational Leadership, 27(2), 60–72. https://doi.org/10.1177/15554589231211870

Boon, H. (2024). A comprehensive approach to water literacy in the context of climate change. Education Sciences, 14(6), Article 564. https://doi.org/10.3390/educsci14060564

Damoah, B., & Omodan, B. I. (2023). Tracing the footprints of environmental education in teacher education: A review of pre-service teachers' training in universities. Journal for Educators, Teachers and Trainers, 14(5), 184–196. https://doi.org/10.47750/jett.2023.14.05.020

Delen, İ., Sen, N., Özüdoğru, F., & Biasutti, M. (2024). Understanding the growth of artificial intelligence in educational research through bibliometric analysis. Sustainability, 16(16), Article 6724. https://doi.org/10.3390/su16166724

Drost, B. R., & Levine, A. C. (2021). An analysis of strategies for teaching and assessing standards-based assessment design to preservice teachers. Journal of Education, 203(3), 574–586. https://doi.org/10.1177/00220574211038711

Evans, N., Ferreira, J., Davis, J. M., & Stevenson, R. B. (2016). Embedding EfS in teacher education through a multi-level systems approach: Lessons from Queensland. Australian Journal of Environmental Education, 32(1), 65–79. https://doi.org/10.1017/aee.2015.47

Eze, E., Nwagu, E. K. N., & Onuoha, J. C. (2022). Nigerian teachers' self-reported climate science literacy and expressed training needs on climate change concepts: Prospects of job-embedded situative professional development. Science Education, 106(6), 1535–1567. https://doi.org/10.1002/sce.21743

Gopalakrishnan, A. C., Bhaskaran, S., & Ambujakshi, S. (2019). Relationship between proactivity and personal pedagogical knowledge in ESD among pre-service teachers: Sub-sampling on social media usage and subject discipline. Journal of Teacher Education for Sustainability, 21(2), 73–90. https://doi.org/10.2478/jtes-2019-0018

Haseski, H. İ. (2019). What do Turkish pre-service teachers think about artificial intelligence? International Journal of Computer Science Education in Schools, 3(2), 3–23. https://doi.org/10.21585/ijcses.v3i2.55

Hassan, M. S., Radzi, S. F. M., & Kanasan, V. (2020). Issues and challenges in the design of sustainability for curriculum using WUSA (World Universities Sustainability Assessment). International Journal of Academic Research in Progressive Education and Development, 9(2). https://doi.org/10.6007/IJARPED/v9-i2/7348

Hilfert-Rüppell, D., Meier, M., Horn, D. N. V., & Höner, K. (2021). Professional knowledge and self-efficacy expectations of pre-service teachers regarding scientific reasoning and diagnostics. Education Sciences, 11(10), Article 629. https://doi.org/10.3390/educsci11100629

Hinson, J., Arthur, C. O., & Bipembi, H. (2023). The effect of peer-to-peer mentoring on initial teacher professional development at Holy Child College of Education. Journal of Education and Practice, 14(20), 1–16. https://doi.org/10.7176/JEP/14-20-01

Hogan, D., & O'Flaherty, J. (2021). Addressing education for sustainable development in the teaching of science: The case of a biological sciences teacher education program. Sustainability, 13(21), Article 12028. https://doi.org/10.3390/su132112028

Hokayem, H., & Jin, H. (2019). Enhancing environmental literacy in K–12 science classrooms. Eurasia Journal of Mathematics, Science and Technology Education, 15(6). https://doi.org/10.29333/ejmste/105767

Isac, M. M., Sass, W., De Maeyer, S., Schelfhout, W., Van Petegem, P., & Claes, E. (2022). Differences in teachers' professional action competence in education for sustainable development: The importance of teacher co-learning. Sustainability, 14(2), Article 767. https://doi.org/10.3390/su14020767

Kanandjebo, L. N. (2024). Mathematics as a driver for sustainable development: Pre-service teachers' perspectives on awareness, challenges, and implications for teacher training. Interdisciplinary Journal of Education Research, 6, 1–17. https://doi.org/10.38140/ijer-2024.vol6.26

Kildė, L. (2024). The integration of generative AI in foreign language teacher education: A systematic literature review. Pedagogika, 154(2), 5–26. https://doi.org/10.15823/p.2024.154.1

Knogler, M., Böheim, R., Diery, A., Harackiewicz, J. M., & Seidel, T. (2025). Promoting positive beliefs toward research evidence: Results from a utility-value intervention study with pre-service teachers. Frontiers in Psychology, 16, Article 1391931. https://doi.org/10.3389/fpsyg.2025.1391931

Lam, T. N. (2024). Enhancing the quality of competency assessment for elementary school students in modern education. International Research Journal of Management, IT and Social Sciences, 10(3), 93–101. https://doi.org/10.21744/irjmis.v10n3.2429

Lasekan, O. A., Malik, R., & Méndez, C. (2020). A conceptual research model for investigating the impact of online teacherpreneurship education on students' teacherpreneurial competencies and intentions in preservice teacher education. International Journal of Learning, Teaching and Educational Research, 19(12), 163–189. https://doi.org/10.26803/ijlter.19.12.9

Luo, R., & Ye, Z. (2021). What makes a good-quality language MOOC? An empirical study of criteria to evaluate the quality of online language courses from learners' perspectives. ReCALL, 33(2), 177–192. https://doi.org/10.1017/S0958344021000082

Mafugu, T. (2022). Science pre-service teachers' experience with mentors during teaching practice. Eurasia Journal of Mathematics, Science and Technology Education, 18(11), Article em2170. https://doi.org/10.29333/ejmste/12476

Maharika, I. F., Irsan, A., Athas, S. I. A., Susanto, A., Abma, V., & Yuriandala, Y. (2020). Building information modelling (BIM) adoption model for architectural education. Journal of Design and Built Environment, 20(3), 22–42. https://doi.org/10.22452/jdbe.vol20no3.2

Mangaroska, K., Vesin, B., Kostakos, V., Brusilovsky, P., & Giannakos, M. N. (2021). Architecting analytics across multiple e-learning systems to enhance learning design. IEEE Transactions on Learning Technologies, 14(2), 173–188. https://doi.org/10.1109/TLT.2021.3072159

Masoumi, D. (2020). Situating ICT in early childhood teacher education. Education and Information Technologies, 26(3), 3009–3026. https://doi.org/10.1007/s10639-020-10399-7

Menzie-Ballantyne, K., & Ham, M. (2021). School Strike 4 Climate: The intersection of education for sustainable development, education for global citizenship and the Australian curriculum. Australian Journal of Environmental Education, 38(1), 85–95. https://doi.org/10.1017/aee.2021.14

Mientus, L., Hume, A., Wulff, P., Meiners, A., & Borowski, A. (2022). Modelling STEM teachers' pedagogical content knowledge in the framework of the refined consensus model: A systematic literature review. Education Sciences, 12(6), Article 385. https://doi.org/10.3390/educsci12060385

Molefe, L., & Aubin, J.-B. (2023). A nexus of scientific investigations, science process skills, and sustainable development goals: Pre-service teachers' views concerning mangroves fieldwork. Journal of Baltic Science Education, 22(4), 682–700. https://doi.org/10.33225/jbse/23.22.682

Ortíz, D. C., Serra, T., Bubnys, R., & Colomer, J. (2019). Pre-service teachers' reflections on cooperative learning: Instructional approaches and identity construction. Sustainability, 11(21), Article 5970. https://doi.org/10.3390/su11215970

Martínez-Pérez, S., Cabero-Almenara, J., Barroso-Osuna, J., & Palacios-Rodríguez, A. (2022). T-MOOC for initial teacher training in digital competences: Technology and educational innovation. Frontiers in Education, 7, Article 846998. https://doi.org/10.3389/feduc.2022.846998

Perkkilä, P., & Joutsenlahti, J. (2021). Academic literacy supporting sustainability for mathematics education: A case of collaborative working as meaning making for “2/3.” In Developing Mathematics Education for Sustainable Development (pp. 163–188). MDPI. https://doi.org/10.3390/books978-3-03897-893-0-8

Rasis, R., Paidi, P., Suhartini, S., Kuswanto, H., & Hartanti, R. D. (2023). The effect of environmental education open inquiry learning kits on the environmental literacy of pre-service biology teachers. Journal of Teacher Education for Sustainability, 25(1), 40–63. https://doi.org/10.2478/jtes-2023-0004

Schissel, J. L., & Reyes, M. (2020). Preparing to teach emergent bilinguals. Journal of Multilingual Theories and Practices, 1(2), 290–312. https://doi.org/10.1558/jmtp.17669

Van der Waldt, G. (2024). Global and transnational governance: Implications for public administration teaching. Teaching Public Administration, 43(3), 259–280. https://doi.org/10.1177/01447394241229173

Wu, L., & Li, T. (2025). Nexus of faculty feedback quality and students' deep approaches to learning in general education: A mixed-methods study. SAGE Open, 15(1). https://doi.org/10.1177/21582440251328081

Zakeri, N. N. B., Hidayat, R., Sabri, N. A. B. M., Yaakub, N. F.B, Balachandran, K. S., & Azizan, N. I. B. (2023). Creative methods in STEM for secondary school students: Systematic literature review. Contemporary Mathematics and Science Education, 4(1), Article ep23003. https://doi.org/10.30935/conmaths/12601

Zhong, L. (2017). Using learning analytics to improve instructional support design for online learning. Journal of Educational Technology Development and Exchange, 10(2), 25–36. https://doi.org/10.18785/jetde.1002.02

Zikra, Z., Fikri, M., Afdal, A., Sukmawati, I., Sin, T. H., Nurhastuti, N., & Suryanef, S. (2024). Technology pedagogical content knowledge framework to prepare Indonesian career counselors. International Journal of Evaluation and Research in Education, 13(2), 820–830. https://doi.org/10.11591/ijere.v13i2.25860