Pages

Wednesday, March 10, 2010

What is Grade Fog

I met with a school staff the other day to facilitate learning and reflection about grading and assessment practices. We started with a sample of student work. The geography assignment asked that students be able to name the Mid-Atlantic states (US).

The student's score was 80%.

I asked the staff, "What does the 80% tell you about the student's knowledge of the Mid-Atlantic states?"

The responses captured were that the student pretty much knew the states with some errors in knowledge of all the states in the category: Mid-Atlantic. This seemed reasonable given the score. I then asked them to look closer at the assignment, review the correction marks where points were taken off, and see if the assessment of the student's knowledge held.

The directions asked students to take the list of states, capitals, and bodies of water and do two tasks.

  1. Label the outlines of states and bodies of water with the correct names, and include the capitals in their corresponding state. All names had a specific color to be written (students used colored pencils).
  2. Shade in each state with an assigned color.
On closer inspection, the staff discovered that the student made all labels correctly. Each state had the correct name, with its capital. The bodies of water were also listed correctly.

While the states were shaded in with the correct color, the labels were all in black pencil, not the assigned colors. Points were taken off for each of the labels that did not have the correct color.

Final score: 80%

If the focus was on students' understanding of the Mid-Atlantic states, this student demonstrated 100% proficiency. If the outcome addressed following directions with color coding, this student showed 80% proficiency. Might have potential confusion been eliminated by listing two assessment scores?

Knowledge of Mid-Atlantic States: 100%
Following Directions regarding color coding: 80% 

Grade Fog is when an assessment becomes unclear due to unclear learning targets. Or when several targets are combined into a single assessment score. It's like taking a grilled glazed salmon, roasted herbed chicken, and a seasoned steak, and mash them together, then conduct a taste test to determine the cook's quality for each of the proteins. 

Classroom assessments are valuable to how a teacher can track learning progress. Clear data allows for strategic interventions where needed. Foggy data conceals who needs help, and in what fashion of intervention or challenge should be provided.

In another instance, a student had on the report card a failing mark for Reading. The exam asked students to complete short answer essay questions based on a novel the class read. Based on the student's written responses, the assessment results appeared accurate. The teacher took the student aside and through an interview, asked the student questions about the novel. The student spoke on the questions with far greater depth than the written responses.

The teacher had realized that for the student, poor writing skills impeded demonstration of understanding. The assessment was on Reading, but writing skills became an obstacle to accuracy of the learning targets.

What grade fog might you find in your work or realm of influence?

2 comments:

  1. You spoke about this when you visited our school with Blandina a few months ago. You are absolutely correct! I think we need to be very careful when constructing and using assessments. We need to have a clear understanding of what we are hoping to assess and be reasonably certain that the "assessment" and scoring scheme are appropriate. As an aside, even th MEAPs can be guilty of this problem. I have seen several occasions where questions on the Math test attempted to "trick" students by changing units of measurement between the question and array of answers.

    ReplyDelete
  2. Hi Kliges,
    Thanks for pointing out the importance for educators to be very careful (dare I add the word: thoughtful) when constructing assessments. They shape our judgement as to what students know or don't know. Standardized tests like the MEAP can be guilty of the same, as you point out. Classroom teachers have the greatest influence on the assessments they develop and/or use. These can be polished to best suit our needs. Welcome to the Lighthouse club. Let's clear some fog :)

    ReplyDelete