Are we setting up students to fail?

Excellent school marks don’t necessarily lead to excellent exam marks  

Robert Laurie, director of education policy, Atlantic Institute for Market Studies | Jun 05, 2007 |

The following report was published by the Atlantic Institute for Market Studies.

The PDF can be downloaded HERE.

"How low can you go?" seems to be the prevailing approach of many high school math teachers when it comes to student expectations. This goes against every serious study which concludes that raising student expectations is the way to go if we want students to succeed.

Let’s be clear: the practice of handing out excellent grades to students who don’t always deserve these grades is not a new phenomenon. A wealth of literature discusses this phenomenon called grade inflation. Interestingly, the practice of grade inflation is usually discussed and criticized at the university level. But if grade inflation is pervasive in universities what about in our high schools? Does it even exist? If so, how bad is it and what are its effects on student performance?

Mathematics scores in New Brunswick francophone high schools tell an interesting tale. A pattern emerges when one combines three consecutive years of average school marks(those which are completely decided by teachers)and provincial exam(PE)marks. Figure 1 shows the average school marks and the average PE marks for school years 2001-2002 to 2003-2004.

Continued Below

 

It is easy to see that the school marks in all 21 high schools were higher than the provincial exam marks. The provincial average for school marks is 73.7 % while the average for PE marks is 60.1 % over the three years.

If the provincial exams are tailor made to reflect the provincial curriculum it seems appropriate to ask why the school marks are always higher than the provincial exam marks. Since teachers are required by law to teach the provincial curriculum shouldn’t the teacher assigned marks be about the same as those on the provincial exams? Not necessarily.

While provincial exams do assess student performance based on the prescribed curriculum, these exams cannot, nor do they purport to, assess every student outcome in the curriculum. Clearly, teachers are in a better position than external exams when it comes to assessing some student outcomes. So while both ways of assessing students are perfectly acceptable, and necessary for different reasons, one must realize that they are measuring slightly different things. It follows then that the results may differ.

Another argument sometimes used to explain the lower provincial exam marks is that they span the whole course whereas the teacher assigned marks are made up of a series of short term tests and other work which cover only a small section of the curriculum. Since it is easier to remember only a small section of the curriculum instead of all of it the argument is made that it is not surprising that students do better on class tests than provincial exams. So the existence of a somewhat constant gap between teacher assigned grades and provincial exam grades should not be a surprise.

This analysis will focus on cases where the difference between teacher assigned grades and provincial exam grades lie outside the “normal” gap. We will show that grade inflation is a BIG problem and that higher standards not higher grades should be the goal.

If it is somewhat normal to observe higher teacher assigned marks than those obtained on provincial exams then why all the fuss about grade inflation? Grade inflation is generally seen to reflect on the teacher’s or the school’s academic expectations towards the students; the higher the grade inflation the lower the expectations and vice-versa.

In the context of provincial exams and teacher assigned grades, grade inflation is defined as the difference between the teacher assigned marks and the results on a provincial exam for that particular course. For example, say a class has a teacher assigned average mark of 85 % and that same class has a 70 % average on the provincial exam we would say that there was 15 % grade inflation.

Now if high expectations are supposed to lead to high results and low expectations to low results we should see two things: 1)lower teacher assigned marks should lead to high achievement on the provincial exams, and 2)higher teacher assigned marks should lead to low achievement on provincial exams. So what do the data tell us?

We calculated the average grade inflation for grade 11 mathematics for each francophone and anglophone high school in New Brunswick as well as for the Math 3204 course in Newfoundland and Labrador. The New Brunswick francophone data is taken over three consecutive school years, 2001-2002 to 2003-2004 as is the Newfoundland and Labrador data for school years 2002-2003 to 2004-2005. We only have two years of data for the New Brunswick anglophone schools, 2001-2002 to 2002-2003, an impact of the decision to eliminate provincial exams in the spring of 2004.

 

Moreover, for nine anglophone schools data are only available for one of the two years. Due to these differences the New Brunswick francophone and the Newfoundland and Labrador data are more representative and stable. Nevertheless, the data tell the same story.

Figure 2 shows grade inflation and student performance on the grade 11 mathematics provincial exams for each of the 21 francophone high schools. The first observation is that both sets of points are practically mirror images of each other. This means that in general, lower grade inflation points to higher provincial exam results. This is most obvious in four schools; Polyvalente Louis-J-Robichaud, Polyvalent Mathieu-Martin, École Grande-Rivière and Polyvalente Roland-Pépin Not only do these four schools have the lowest grade inflation with values ranging from -0.7 % to 9.3 % but they are also the four top performing schools on the grade 11 mathematics provincial exams.

Not surprisingly, higher grade inflation points to lower provincial exam results. Of the 21 high schools, École Marie-Gaëtane has the highest grade inflation, at 24.7 %. With a provincial exam average of 52.3 % this school is also the least achieving school in the province. These observations are exactly what we should see if the hypothesis of high expectations high results, low expectations low results is correct.

Anglophone data, while not as robust, show a somewhat similar visual pattern to the francophone date as seen in Figure 3.

Visually, the most obvious case that stands out is that of Southern Victoria High School(school #43)  which clearly has the highest grade inflation at 29.5 % and the lowest achievement on the provincial exam at 45.5 %.

Not surprisingly, the two schools which showed the best performance on the provincial exams with an average of 76.0 %(Moncton High School, #10; and Canterbury High School, #39)show grade inflation at only 1.0 %. Clearly, the expectations   towards   students   at   these   two schools are much more aligned to those of the provincial curriculum than they are at Southern Victoria High School.

 

Predictably, the story unfolds in the same way in Newfoundland and Labrador. The most obvious case here is that of St. Joseph’s All Grade School(school #73)  which actually shows grade deflation instead of grade inflation. In this case the school mark is 9.9 % LOWER than the provincial exam mark of 78.6 %, the best in the province.

At the other end of the spectrum, the two schools which have the most grade inflation(Cloud River Academy – school #53, St. Michael’s Regional High – school #50)have poor results on the mathematics 3204 provincial exams with averages over 3 years of 49.8 % and 39.9 % respectively.

 

So what you ask? Let’s assume the following hypothetical situation to see the impact and seriousness of this situation. Suppose your child attends Canterbury High School and your nephew Southern Victoria High School, two high schools in the New Brunswick anglophone school system. Your child brings home a report card with a math mark of 75 % and your nephew a mark of 77 %. You would naturally assume that your child and your nephew are performing at about the same level in math. How would you explain that your child will probably score about 30 % less on the provincial exam while your nephew’s mark will probably remain the same? Welcome to the world of grade inflation.

It is clear that grade inflation is alive and well in many New Brunswick and Newfoundland and Labrador high schools. It is also clear that grade inflation is much more prevalent in some high schools than others. Why can’t all high schools have high expectations towards their students’ performance? Could it be that assessment policies are either not clear or ignored? Might some schools reward students with marks for things that are not on the curriculum like attendance, class participation, doing homework and the like?

Although there will probably always be a gap between teacher assigned grades and provincial exam results each teacher must strive to be below that average gap by increasing their expectations towards student’s performance.

Research has shown that students rise to the challenge as long as the challenge is fair. Moreover, there is also a wealth of research to support the fact that high expectations are especially beneficial to struggling students. And the opposite is true: teachers who don’t expect much from their students get exactly that. So if we really want to improve student performance why not start by ensuring that we report what students have actually learned rather than inflating their grades which is really another way of telling students that all is OK when the opposite is true?

Inflating grades is a set-up for massive disappointment later on. Sooner or later reality will catch up to the students and “success” won’t come so easy. The cost of failure may be as high as being forced to withdraw from post secondary institutions, loss of job opportunities, and even jobs themselves. These individual failures reflect an education system which fails students and society. Without a serious and concerted effort to change the practice of grade inflation everyone loses.

For many years our high school students have consistently ranked poorly in pan Canadian and international assessments. Instead of lowering the bar and asking how low can you go? teachers should raise the bar and work with students to see how high they can jump.