Cover image by Kei from Pixabay
By Megan Sumeracki
Last week, my blog post covered a paper by Simon Cullen and Daniel Oppenheimer. Their paper is titled Choosing to Learn: The Importance of Student Autonomy in Higher Education (1). In their paper, they present two studies.
The first study, covered in Part 1, was a randomized controlled field study examining the effects of allowing students to choose whether their attendance was mandatory. Let’s review: In study one, the researchers randomly assigned sections of a college course to have one of two different course policies. Under one policy, the students’ attendance was required, and affected their grade (positively if they missed no more than 3 classes, and negatively if they missed more). Under the other policy, students got to choose. They opted in to the same attendance policy as the other sections, or they opted out and attendance wasn’t tracked nor did it affect their grade. The main takeaways were: 1) most students opted into the attendance policy (about 90%); and, 2) attendance was a bit better, and significantly more consistent throughout the semester, in the sections that made the policy optional relative to the sections that made the policy mandatory.
In the second study, the authors conducted a cohort study examining the effects of allowing students to opt out of challenging, high-effort assessments. This study is the topic of today’s post.
Study 2: Opting out of Challenging, High-Effort Assessments
The authors motivated this study, in particular, by noting that regular assessments and feedback are important for students. However, if students have assignments that are worth very little to their grade, they may not spend as much time and effort. And, forcing students to complete so many assessments can reduce autonomy and have negative effects (e.g., spending less time and effort, procrastinating, or skipping assignments). If instructors weigh assignments more heavily in the final grade, that could push students to spend more time and effort, but then the stress of these assignments could end up hurting student learning and student well-being. Thus, the authors are trying to find a way to encourage students to put forth a lot of effort without such high-stakes assessments.
The Method
The authors tested a course policy in which students were given assessment options and were allowed to choose, compared to mandatory policies. The study was conducted with college students taking an introductory philosophy course across two semesters (i.e., there were two cohorts of students*).
*Note: Students were not randomly assigned to conditions, but rather were in one condition or the other based on when they took the course (their cohort). This makes determining cause-and-effect relationships more difficult. You can see this blog post on research methods to read about these issues. The authors did look at a number of variables, such as seniority, major, etc. and found no statistical differences between the two cohorts. Still, without random assignment, even at the section level like in the first study, the authors cannot rule out alternate causes (or “confounds”). The authors rightly acknowledge this.
One cohort of students had a mandatory assignment policy. The students were required to complete 20 “argument analysis” problem sets.
The second cohort of students had a free-to-switch assignment policy. These students could choose between the problem sets and an alternative essay-based assignment. The essay assignments required less work than the problem sets, and included answering weekly reading questions and writing 5-page midterm and final essays. All students were told about the relative difficulty of the two assignment tracks, and students could switch into the lower-effort (essay) track at any point before the midterm.
When students completed assignments, they self-reported how much time they spent. The professor graded the assignments for the class. Students earned 0, 1, or 2 points on each of the problem sets. To earn at least 1 point, students needed to submit a “meaningful attempt” before the deadline.
