Monday, May 30, 2016

Specifications Grading in Biological Anthropology: Part 1 - Learning Goals

This is the first in a series of posts about creating, implementing, and modifying a specifications grading system. You can find them all by clicking on the "specifications grading" label below.

Introduction to Biological Anthropology is one of my biggest classes. About 10% of students here at UMM take the class to fulfill their science GenEd. It's one of my favorite classes to teach, but for years I've tinkered with it, trying to improve student outcomes. I've flipped the class, given students exam questions ahead of time, and instituted a specifications grading system. The result: a noticeable improvement in student learning and student grades, although the failure rate continues to be high.

The specifications grading system caused a bit of a stir on campus when I rolled it out in Spring 2015. Students expressed their concerns to other faculty at the beginning of the semester, only to come back at the end to tell them how much they loved the grading system and would like to see it implemented in more classes. Unsurprisingly, a number of those faculty members then asked me "what do you mean by specifications grading?"

So, without further ado...

What do I mean by specifications grading?

Specifications grading systems are based on a book by Linda Nilson. At its heart, specifications grading is a mastery system: students show mastery of a concept or skill in order to pass an assessment. The more skills or concepts are mastered, the more assessments passed, the higher grade the student earns. It reminds me of my high school chemistry class: there were a number of self-paced units, each with associated lab work, homework, and an exam. You had to pass the exam with at least a C to move on to the next unit. Your final grade was entirely dependent on how many exams/units you passed, not on your percentage grade on the exam. If you only did a couple units, you'd fail. If you did ten or more, you'd get an A. (Incidentally, that analogy worked well for explaining the system to my students, even though I wasn't using a self-paced unit structure.)

In a standard, non-specifications grading system, a student passes the class by averaging at least a 60% in total points. If a class has any "easy points", such as points for attendance, this means a student could pass the class without truly mastering any of the core concepts or skills. Sure, if they do that for a lot of classes they'll get suspended, but we all want our students to leave our classroom with a basic understanding of our field, right?

Specifications grading makes it very clear, to both students and professor, what constitutes a passing-level understanding of the class material, what constitutes a C-level understanding, what constitutes a B-level understanding, etc., etc., and then ensures students reach that level of understanding in order to earn that grade. This increases both academic rigor and accountability. It also ensures that any student moving on to the next class in a sequence has the necessary skills to do well.
from Dee Fink https://www.deefinkandassociates.com/GuidetoCourseDesignAug05.pdf

I love it.

How did I develop my course?

In creating the new BioAnth course, I used a combination of Nilson's book and the work of Dee Fink on designing courses for significant learning. (I highly recommend following that link to an excellent PDF guide to course development.) The two approaches work very well together. I began, as Fink suggests, thinking about my learning goals. He recommends six different categories of learning goals, as seen in the figure above. Mine were as follows:

Learning Goals for Intro to Biological Anthropology:

Long-term:
  • A year or more after this class is over, I hope that all students will be able to critically evaluate claims about human nature, understanding that our genes are expressed through our social and physical environment, and recognizing that much of what we consider “inherent” to our biology is actually a reflection of our culture, because we have evolved to be flexible rather than to follow rigid rules of behavior. (In other words, when you sit down to Thanksgiving dinner with your least-favorite cousin, you should be able to intelligently debunk the latest media claims about race, gender, or overall human nature.)
Foundational Knowledge: Students should be able to explain in their own words and give examples of the following key concepts:
  • Scientific method in the historical sciences (fields such as anthropology, evolutionary biology, ecology, and astronomy) D
  • Culture D
  • Evolutionary theory D
  • The influence of both environment and genetics (humans as "naturenurtural") C
  • The human adaptation/niche B
Application: Students should be able to:
  • work "hands-on" with materials that tell us about human adaptation and evolution (fossils, biometric data, etc.) D
  • create and evaluate scientific arguments and evidence C
  • critically evaluate scientific arguments about fundamental human nature (based on race, gender, our hunter-gatherer past, etc.) B
  • find and be able to summarize multiple perspectives on key topics like race, gender, and culture B
Human Dimension Over the course of the semester, students should:
  • identify and list what about themselves is shared with all people around the world, and what is unique to their cultural perspective. C
  • develop their feelings of empathy for, interest in, and connection to people around the world. C
  • recognize where their own cultural filters are affecting their interpretation of the world around them. B
  • develop their skepticism for claims that biologically-based differences between people of different races, genders, etc., override culturally and contextually determined differences. A
Integration: Students should take from this class a set of ideas and skills that can be applied outside of the course, including:
  • Students should be able to apply evolutionary theory to all the topics in this course, as well as topics in other relevant courses (such as biology, philosophy, pseudo-scientific arguments in political science and economics, etc.) C
  • Discussions of human diversity and evolution that take place in other classes (history, political science, psychology, etc.) should be informed by the anthropological understanding of human differences in a broader context. B
  • Science never takes place in a cultural vacuum. Students should recognize that the cultural context of scientific endeavors affects interpretations, even on topics that are less emotionally charged than defining ourselves as a species. A
 

After creating these learning goals, I went back and added grade levels to each (shown in red above). In order to get a D in the class, students need to reach only those learning goals that say "D". In order to get a B in the class, students need to reach those learning goals that say "B", but also those that say "C" and "D". Those goals that say "A" need only be mastered by students who want the top grade (but those students will also have to master the "D", "C", and "B" goals).

Some things to consider when creating learning goals for specifications grading systems:

1) As Nilson discusses in her book, the learning goals must be testable and the way they will be evaluated should be clearly stated. Note that under "Foundational Knowledge" I don't say "students should know...", I say "students should be able to explain in their own words and give examples of...". No surprise, on exams I ask students to define and give examples of these concepts.

2) The D-level or passing learning goals are a mixture of truly fundamental concepts for the whole field (like evolution or culture) and those skills/concepts that are most easily grasped. There are some skills/concepts that I would love to require of all students (for example, the ability to critically evaluate claims about biological determinism), but my experience with this class in previous iterations convinces me that requiring all students to master a skill of that complexity would, essentially, lead to a 90% failure rate.

3) But, but...but all of my students should master all of the material! Yes, yes, I know you feel that way, but you have to let it go. It was truly painful for me to admit that not all of my students would be able to, say, develop an understanding of the influence of cultural context on science and therefore not even require it for students below the A level. The truth is, students with lower grades weren't mastering this material anyway. Because of the way I structure my class, all students get the same readings and lectures, so they're still exposed to the concepts. At least this way I know that a student passing my class really understands the basic concept of evolution, even if they haven't mastered the more complex arguments, while before they may have passed through without understanding either.


In my next post, I'll talk about how I structured the grading system and some of the changes I'm making this coming year to avoid the (inevitable) problems that come with doing anything new.

No comments:

Post a Comment