Developing and assessing pre- and in-service science and engineering teachers' systems thinking and modeling skills through an asynchronous online course

Systems thinking and modeling are two critical 21st-century skills that teachers and educators are expected to impart to students, and students are expected to acquire and master them as part of their preparation to become literate citizens of a society and environment that is becoming ever more complex. Systems thinking is a thought process in which assumptions about interactions among interconnected elements of a system or a phenomenon can help predict the system's behavior, outcomes, and in the case of human-made artifacts, the value to its beneficiaries. Conceptual modeling involves the simultaneous visual and textual representation of one's ideas about a phenomenon or system in science or engineering. The qualitative study described here aimed to examine the effect of an online interdisciplinary asynchronous course on the development of systems thinking and conceptual modeling skills among pre- and in-service science and engineering teachers. Engaging in a qualitative case study with an exploratory orientation, we investigated how science and engineering teachers and teacher educators coped with (a) online learning of conceptual modeling and systems thinking using Object-Process Methodology in a food and sustainability context, and (b) developing an online assignment for teaching those skills to their students and assessing them. Research tools included the online assignment that the participants developed, dedicated rubrics for analyzing their assignments, accounting for use of modeling, media, visualization, micro-macro-process scientific understanding levels, and a mix of closed- and open-ended questions. Additionally, the participants' reflections were analyzed to characterize their sense of self-efficacy and academic progression. We characterize five teacher-developed assignment cases along with the related teachers' reflections, which exposed the benefits they had gained from the online course, as well as the systems thinking and modeling challenges they had faced. Analysis of the effect of the course with emphasis on the final task reveals that this approach is effective for developing the systems thinking and modeling skills of the teachers and serves as a catalyst for their professional development. The study offers a methodological contribution by providing a basis for evaluating teachers' assessment knowledge and skills using a six attributes rubric.