Research

The Science Education Research Group aims to investigate impactful questions about science education pedagogy. We explore the effectiveness of current practices used in our classrooms as well as new practices. Please find selected publications below.

Selected Publications

How augmented reality influences student learning and inquiry styles: A study of 1-1 physics remote AR tutoring
How augmented reality influences student learning and inquiry styles: A study of 1-1 physics remote AR tutoring. Computers & Education: X Reality (2023). Publisher's VersionAbstract
While augmented reality (AR) technology is being considered by educators for its potential to help students visualize abstract concepts, currently there are barriers from the high cost of developing complex AR applications. In this study we investigate how the complexity of AR content impacts student learning in remote 1-1 tutoring scenarios, where an instructor uses an AR headset while teaching physics concepts to a remote student. This approach brings the benefits of augmented reality into the already-existing educational practices of 1-1 remote instruction, without requiring AR devices for every student. We present a system for AR-based physics instruction and perform a between-subjects study, measuring how student learning and inquiry behaviors differ between two experimental conditions that vary in the complexity of AR content. Through quantitative and qualitative analysis, our results show that students who are tutored with more complex AR content learn better and show a wider variety of inquiry styles. Furthermore, AR visual representations appear to stimulate students to think about a wide range of scientific ideas, to make deeper connections between scientific concepts, and encourage students to have a more active learning style with increased transitions between inquiry activities. We discuss possible reasons and wider implications for these findings.
How gender composition and group formation impact the effectiveness of group work in two-stage collaborative exams
How gender composition and group formation impact the effectiveness of group work in two-stage collaborative exams. Physical Review Physics Education Research (2022). Publisher's VersionAbstract
Two-stage collaborative exams are an increasingly popular form of formative assessment which have shown promising results in promoting student learning. While the benefit of two-stage collaborative exams is well researched, there is no clear consensus on the best way of implementing them—specifically with respect to forming student groups. In some studies students self-select their groups, and in others they are assigned by the instructor (either randomly or with a specific grouping algorithm). Research has shown that performance and satisfaction in group learning situations improves when faculty, not students, select the groups. Furthermore, studies have demonstrated that students’ learning benefits from working in groups with diverse learning styles, abilities, gender, and race. In this study, we report on a controlled experiment conducted during a two-stage collaborative exam in an introductory physics course at Harvard University. For the group stage of the exam, half of the groups were formed by the instructor (based on balancing gender and performance on previous exams) and the other half were student selected. We compared performance on both the individual and group stage of the exam for the instructor-formed versus student-formed groups. We also surveyed students on their experiences during the group exam. We found that female students perform better on two-part collaborative exams when they are in student-formed groups. We also found that in the student-formed groups students (especially female students) felt more comfortable speaking up and felt that their groups were both “more effective and productive” and “more receptive to their ideas” than in the instructor-formed groups. This study provides important insights into best practice implementation of two-stage collaborative exams.
Harnessing active engagement in educational videos: Enhanced visuals and embedded questions
Harnessing active engagement in educational videos: Enhanced visuals and embedded questions. Physical Review Physics Education Research (2022). Publisher's VersionAbstract

The prevalence of online instruction highlights the importance of videos in education. Pedagogies that include elements that actively engage students are accepted as an improvement over more passive modes of instruction. How can we transfer the advantages of active engagement to instruction via video? Previous research on instructional videos has shown that there are a number of principles, the adherence to which benefit student learning by maximizing productive cognitive processing. To understand the impact of combining such principles we designed and produced four different versions of the same physics demonstration video, varying levels of “visual enhancement” designed around these principles and the amount of active engagement across the different versions. Using pre-post video testing, we compared how much viewers learned across the four different versions. We found that actively engaging students by embedding questions throughout the video increases student learning. We also found that physics videos are most effective when they include enhanced visuals and embedded questions. Notably, it is the combination that matters most; the learning effect from embedding questions is increased when the video also includes enhanced visuals. This study represents an important step towards understanding how instructors can design and refine their videos to maximize student learning.

Increased learning in a college physics course with timely use of short multimedia summaries
Increased learning in a college physics course with timely use of short multimedia summaries. Physical Review Physics Education Research (2022). Publisher's VersionAbstract
The typical introductory physics lecture requires students to consolidate and assimilate a large quantity of complex information that is often novel to them. This can leave students overwhelmed, slow the pace of their learning, and lower their motivation. We find that carefully designed multimedia summaries in the form of one-minute videos and short text summaries can significantly increase students’ understanding of the material as well as their ability to organize information into a useful mental framework, as measured by their performances on a concept mapping exercise and a conceptual test of learning. Notably, we show that these improvements can be achieved with negligible increase in overall time students spend on the course material each week. We discuss reasons why these short postlecture summaries helped students learn more, namely, that (i) they likely increased students’ ability to chunk and organize information while minimizing the extraneous cognitive load imposed by the materials, and (ii) they likely improved students’ ability to consolidate and transfer knowledge through the use of contrasting cases. We provide a set of detailed recommendations that instructors can use to develop effective postlecture multimedia summaries. We suggest that one of the most important and impactful recommendations is incorporating student thinking in the design of these types of summaries informed by the input of qualified former students or teaching assistants with significant experience interacting with students in the course.
Increasing the effectiveness of active learning using deliberate practice: A homework transformation
Increasing the effectiveness of active learning using deliberate practice: A homework transformation. Physical Review Physics Education Research (2021). Publisher's VersionAbstract
We show how learning can be improved, beyond that shown in actively taught classrooms, by also transforming the homework using the principles of deliberate practice. We measure the impact of transforming the homework on student learning in a course that had already implemented an active approach to teaching in class. We compare performance on the same final exam in equivalent cohorts of students over three semesters of an introductory physics course: the first taught with traditional lectures and traditional homework, the second taught with active instruction coupled with traditional homework, and the last taught with both active instruction and transformed homework. We find students in the semester where both active teaching and transformed homework are used scored significantly higher on the final exam than the students taught actively but with traditional homework. This learning gain achieved by transforming the homework is comparable to that achieved by replacing traditional lectures with active teaching strategies in class. We further show the positive effects of transforming the homework on student learning through a shorter, controlled experiment. When everything but the homework implementation is controlled, students scored 5%–10% higher on a test of learning following transformed homework compared with traditional homework. This significant improvement to learning occurs despite students spending a similar amount of time on task. This study represents an initial step towards understanding how deliberate practice can be extended to improve pedagogy beyond what happens in the classroom to the out-of-class homework.
Comparing the effectiveness of online versus live lecture demonstrations
Comparing the effectiveness of online versus live lecture demonstrations. Physical Review Physics Education Research (2020).Abstract
Nearly every introductory physics or chemistry course includes live lecture demonstrations, which can range from simple illustrations of a pendulum to elaborate productions with specialized apparatus and highly trained demonstrators. Students and instructors often consider “demos” to be among the highlights of these classes. Yet, in some situations demos may be cumbersome, inaccessible, or otherwise unavailable, and online video demos could offer a convenient alternative. We compared the effectiveness of live demonstrations with online videos under controlled conditions in the first semester of an introductory physics (mechanics) course. Students were randomly assigned to view either a live or video version of two demos. The same instructor presented both versions of the demo using an identical script, keeping the same time on task across both conditions, but with small differences in presentation appropriate to the medium. Compared with the students who saw the live demos, the students who watched the online videos learned more, and their self-reported enjoyment was just as high. We discuss reasons why videos helped students to learn more, including that they are more likely to make correct observations from the video. These results suggest that videos could provide students with an equally effective learning experience when live demos are unavailable. Indeed, even when live demonstrations are available, it may be beneficial to supplement them with online presentations.
More