Previous studies conclusively show that pencil-and-paper lecture-tutorials (LTs) are incredibly effective at increasing student engagement and learning gains on a variety of topics when compared to traditional lecture. LTs in astronomy are post-lecture activities developed with the intention of helping students engage with conceptual and reasoning difficulties around a specific topic with the end goal of them developing a more expert-like understanding of astrophysical concepts. To date, all astronomy LTs have been developed for undergraduate courses taught in-person. Increases in online course enrollments and the COVID-19 pandemic further highlighted the need for additional interactive, research-based, curricular materials designed for online classrooms. To this end, we developed and assessed the efficacy of an innovative, interactive LT designed to teach planet formation in asynchronous, online, introductory astronomy courses for undergraduates. We utilized the Planet Formation Concept Inventory to compare learning outcomes between courses that implemented the new online, interactive LT, and those that used either a lecture-only approach or utilized a standard pencil-and-paper LT on the same topic. Overall, learning gains from the standard pencil-and-paper LT were statistically indistinguishable from the in-person implementation of the online LT and both of these conditions outperformed the lecture-only condition. However, when implemented asynchronously, learning gains from the online LT were lower and not significantly above the lecture-only condition. While improvements can be made to improve the online LT in the future, the current discipline ideas still outperform traditional lecture, and can be used as a tool to teach planet formation effectively.
New physics and astronomy faculty are excited about active teaching, but they still need support to implement the ideas in their classes.
Views Icon Views Article contents Figures & tables Video Audio Supplementary Data Peer Review Share Icon Share Twitter Facebook Reddit LinkedIn Tools Icon Tools Reprints and Permissions Cite Icon Cite Search Site Citation Ardis Herrold, Edward Prather; Explore the expanding universe with Rubin Observatory. Phys. Teach. 1 September 2023; 61 (6): 536–537. https://doi.org/10.1119/5.0156703 Download citation file: Ris (Zotero) Reference Manager EasyBib Bookends Mendeley Papers EndNote RefWorks BibTex toolbar search Search Dropdown Menu toolbar search search input Search input auto suggest filter your search All ContentAmerican Association of Physics TeachersThe Physics Teacher Search Advanced Search |Citation Search
There is a critical need for research-based active learning instructional materials for the teaching and learning of STEM in online courses. Every year, hundreds of thousands of undergraduate non-science majors enroll in general education astronomy courses to fulfill their institution’s liberal arts requirements. When designing instructional materials for this population of learners, a central focus must be to help learners become more scientifically and data literate. As such, we developed a new, three-part, curricular model that was used to inform the creation of active-learning instructional materials designed for use in online courses to help introductory astronomy students improve their ability to make evidence-based conclusions when presented with a variety of data representations, while increasing their self-efficacy with respect to engaging meaningfully in science. We conducted a pilot study of these instructional materials at nine different colleges and universities to better understand whether students’ engagement with these materials lead to increases in self-efficacy, and whether faculty who implemented the materials were able to easily incorporate our active learning materials into their existing online astronomy courses. Overall, we found a statistically significant improvement in students' self-efficacy after engaging with our instructional materials in their online courses. The results of the item-by-item analysis indicated that students’ beliefs improved most on the questions that assessed their ability to make meaningful contributions to scientific research, and their confidence using data representations to interpret an array of scientific questions. The instructor feedback emphasized that our curriculum development model could successfully inform the creation of instructional materials that were easy to implement in existing online astronomy classes, and supported course learning objectives, creating the potential for widespread dissemination and use at the undergraduate level.
General-education college astronomy courses offer instructors both a unique audience and a unique challenge. For many students, such a course may be their first time encountering a standalone astronomy class, and it is also likely one of the last science courses they will take. Thus, in a single semester, primary course goals often include both imparting knowledge about the Universe and giving students some familiarity with the processes of science. In traditional course environments, students often compartmentalize information into separate "life files" and "course files" rather than integrating information into a coherent framework. The astronomy course created through this project, taught at the University of Arizona in Spring 2019, was designed around inclusivity-driven guiding principles that help students engage with course content in ways that are meaningful, relevant, and accessible. Our course bridges the gap between students' "life" and "course files", encourages and respects diverse points of view, and empowers students to connect course content with their personal lives and identities. In this paper, we provide insight into the guiding principles that informed our course design and share research results on the effectiveness of the instructional strategies and assessment techniques implemented in the course.
The ground-breaking image of a black hole's event horizon, which captured the public's attention and imagination in April 2019, was captured using the power of interferometry: many separate telescopes working together to observe the cosmos in incredible detail. Many recent astrophysical discoveries that have revolutionized the scientific community's understanding of the cosmos were made by interferometers such as LIGO, ALMA, and the Event Horizon Telescope. Astro 101 instructors who want their students to learn the science behind these discoveries must teach about interferometry. Decades of research show that using active learning strategies can significantly increase students' learning and reduces achievement gaps between different demographic groups over what is achieved from traditional lecture-based instruction. As part of an effort to create active learning materials on interferometry, we developed and tested a new Lecture-Tutorial to help Astro 101 students learn about key properties of astronomical interferometers. This paper describes this new Lecture-Tutorial and presents evidence for its effectiveness from a study conducted with 266 Astro 101 students at the University of North Carolina at Chapel Hill.
In this paper we put forth a model for physics course reform that uniquely uses proven, research-based active learning strategies to help students improve their physics knowledge and problem-solving skills. In this study, we compared the exam performance of students in two sections of the same introductory physics course. One section (the traditional section, N = 258) was taught by an instructor who is highly regarded for his lectures, but did not use any active learning teaching strategies. The other section (the reformed section, N = 217) was taught by an instructor who had never before taught a physics class but who was trained in physics and astronomy education research and who did use active learning teaching strategies. Students in the reformed section significantly outperformed students in the traditional section on common exam questions over the course of the semester, regardless of whether the question was conceptual or quantitative. This reform effort has been successful at improving students' learning and significantly increasing the department's use of active learning strategies at the introductory level and beyond.
[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Our investigation of 353 faculty-produced multiple-choice Think-Pair-Share questions leads to key insights into faculty members' ideas about the discipline representations and intellectual tasks that could engage learners on key topics in physics and astronomy. The results of this work illustrate that, for many topics, there is a lack of variety in the representations featured, intellectual tasks posed, and levels of complexity fostered by the questions faculty develop. These efforts motivated and informed the development of two frameworks: (i) a curriculum characterization framework that allows us to systematically code active learning strategies in terms of the discipline representations, intellectual tasks, and reasoning complexity that an activity offers the learner, and (ii) a curriculum development framework that guides the development of activities deliberately focused on increasing learners' discipline fluency. We analyze the faculty-produced ThinkPair-Share questions with our curriculum characterization framework, then apply our curriculum development framework to generate (i) fluency-inspiring questions, a more pedagogically powerful extension of a well-established instructional strategy, and (ii) Student Representation Tasks, a brand new type of instructional activity in astronomy that shifts the responsibility for generating appropriate representations onto the learners. We explicitly unpack and provide examples of fluency-inspiring questions and Student Representation Tasks, detailing their usage of pedagogical discipline representations coupled with novel question and activity formats.
The Lecture-Tutorials for Introductory Astronomy have been designed to help introductory astronomy instructors actively engage their students in developing their conceptual understandings and reasoning abilities across a wide range of astrophysical topics. The development of the Lecture-Tutorials has been informed by nearly two-decades of research into common learning difficulties students experience when studying astronomy. The results from multiple studies provide evidence that Lecture-Tutorials can help students achieve learning gains well beyond what is typically achieved by lecture alone. Achieving such learning gains requires that an instructor understand how to effectively incorporate the Lecture-Tutorials into his or her course. This chapter provides details into the best practices for the effective integration and implementation of the Lecture-Tutorials - practices that we have developed through years of reflective practice from working with thousands of Astro 101 students and instructors. We also present a case study of how Lecture-Tutorials were used to promote the active engagement of learners in an Astro 101 mega-course enrolling over 700 students. This case study illustrates how the thoughtful implementation of Lecture-Tutorials can result in dramatic learning gains, even in the most daunting instructional environments.
The discovery and characterisation of planets orbiting distant stars has shed light on the origin of our own Solar System. It is important that college-level introductory astronomy students have a general understanding of the planet formation process before they are able to draw parallels between extrasolar systems and our own Solar System. In this work, we introduce the Planet Formation Concept Inventory (PFCI), an educational research tool used to assess student learning on the topic of planet formation. The PFCI Version 3 was administered to N = 561 students pre-instruction and N = 374 students post-instruction. Here, we present a Classical Test Theory (CTT) analysis of the PFCI Version 3. Ultimately, we conclude that the PFCI is a reliable and valid instrument that can differentiate experts from novices, and can be used to assess college-level introductory astronomy students' learning on the topic of planet formation. Initial findings on class normalised gain scores indicate that the PFCI may be capable of assessing the effectiveness of different instructional models. In the future, we recommend a national study of the PFCI to discern its ability to provide insight regarding the ascribed characteristics of learners and the effectiveness of different instructional strategies being used to teach this topic.
We report the results of a large-scale study of the state of science content knowledge of volunteers in Galaxy Zoo ( www.galaxyzoo.org ), an online citizen science project in which public volunteers classify galaxies in an effort to benefit cutting-edge astronomy research. We were interested in whether participating in Galaxy Zoo leads to any increase in participants’ astrophysical content knowledge. To assess volunteer content knowledge, we examined the responses of 1476 Galaxy Zoo volunteers to 32 conceptually challenging multiple-choice questions. We looked for any relationships between participants’ assessment scores and the number of galaxies classified upon answering the first assessment question, the number of galaxies classified between their first response and their final response to the assessment, and the length of time since they first created their Galaxy Zoo account. All relationships were of small effect size. These results suggest that participation in the project’s central galaxy classification task, in and of itself, is not associated with increased astrophysical content knowledge. We strongly recommend that future studies of online citizen science environments examine how volunteers take advantage of opportunities to develop their knowledge and skills outside of the self-contained central task, especially in the context of opportunities for interactions with other volunteers.
“Wow! I wish I’d written that question...” Many instructors struggle to write Peer Instruction questions that can drive the intellectually engaging discussions necessary to fully develop learners’ discipline fluency. Does your question bank contain the questions you need? How would you go about evaluating this and even if you did, how would you know what you’re missing? We present a framework for uncovering the variety in the discipline representations, intellectual tasks, and difficulty levels employed in hundreds of multiple-choice questions produced by faculty in our workshops over the years. We then exploit this framework to generate new questions using underutilized representations and tasks. Through this work, we illustrate a process for creating fluency-inspiring questions. Learning environments that make use of fluency-inspiring questions afford learners more robust opportunities to unpack complex concepts, practice critical discernment, and develop discipline fluency.
The Green Bank 20-meter radio telescope integrated into the Skynet Robotic Telescope Network offers a unique opportunity to engage learners in investigations that are not possible with optical telescopes. Radio investigation of the Milky Way using the neutral hydrogen (HI) 1420.41 MHz emission line have a long history with the educators at Green Bank Observatory and through the Skynet team. The project discussed considers how best to adapt these investigations into a large-enrollment, general education, introductory college astronomy course (“Astro 101”). Astro 101 courses serve over 250,000 students nationwide each year. To conduct a class-wide investigation of the Milky Way, we first have each student collect a 60-second radio spectral scan of the HI emission line for a single portion of the galactic disk. Once this class data over a wide range of galactic longitudes is combined, the students can use simple geometry and Doppler information to determine that we live in a spiral galaxy and that we orbit the galactic center clockwise (if looking down on the Galactic North Pole). Together with archived data of the Large and Small Magellanic Clouds, a galactic rotation curve and an enclosed mass curve can be created to illustrate the “missing mass” problem as evidence for existence of dark matter. Results from a formative assessment illustrate that this project helps students connect concepts learned in class and gain confidence in their abilities to do scientific research. Activity lecture slides and data spreadsheets are freely available.
This paper presents the first item response theory (IRT) analysis of the national data set on introductory, general education, college-level astronomy teaching using the Light and Spectroscopy Concept Inventory (LSCI). We used the difference between students' pre- and post-instruction IRT-estimated abilities as a measure of learning gain. This analysis provides deeper insights than prior publications into both the LSCI as an instrument and into the effectiveness of teaching and learning in introductory astronomy courses. Our IRT analysis supports the classical test theory findings of prior studies using the LSCI with this population. In particular, we found that students in classes that used active learning strategies at least 25\% of the time had average IRT-estimated learning gains that were approximately 1 logit larger than students in classes that spent less time on active learning strategies. We also found that instructors who want their classes to achieve an improvement in abilities of average $\Delta \theta = 1$ logit must spend at least 25\% of class time on active learning strategies. However, our analysis also powerfully illustrates the lack of insight into student learning that is revealed by looking at a single measure of learning gain, such as average $\Delta \theta$. Educators and researchers should also examine the distributions of students' abilities pre- and post-instruction in order to understand how many students actually achieved an improvement in their abilities and whether or not a majority of students have moved to post-abilities significantly greater than the national average.
One goal for a scientifically literate citizenry would be for learners to appreciate when the Earth came to be and where it resides in the Universe. Understanding the Earth's formation in time in both a sociohistorical and scientific sense allows us to place humanity within the larger context of our existence in the Universe. This article considers prior research from cognitive science, psychology, history, and Earth and space science education to inform a new research agenda in astronomy education. While there exists prior research related to learner's ideas of time and the Earth's location, research on how to help students develop a coherent model of the Earth's place in space and time in the Universe is still lacking. We highlight a set of preliminary findings from a pilot study that is part of this new agenda, which is focused on students' ideas on how to connect the Earth's formation with prior events in the Universe.
Loukas Lazos合作论文数Department of Electrical & Computer Engineering, College of Engineering, University of Arizona3