Mast Kalandar

bandar's colander of random jamun aur aam

Mon, 14 Sep 2015

Ranking versus Grading

Tags: , , [link] [comments (0)] [raw]

There are two different types of evaluations that are often mixed up.

In a context where there are a limited number of "awards" and a large number of applicants, we need to pick those who "deserve" the awards. In order to do this we are forced to rank the applicants. Such an evaluation classifies as a ranking evaluation.

In other contexts, we are trying to determine whether a given individual has met certain requirements. There may be many such requirements and the examiner may want to classify (assign a grade) according to the number of requirements met. Even when this is one individual out of a big population of examinees, this classifies as a grading evaluation.

In a ranking examination, factors which may be only marginally relevant to the awards can be (and often have to be!) used to create a "total ordering" in a mathematical sense. As long as these factors are fairly chosen and applied, and are known to the participants in advance, most people, however unhappy they may be at having "lost out", should (and perhaps will!) grant the acceptability of the ranking.

A typical classroom evaluation or course evaluation is meant to be a grading evaluation. The question asked is whether the examinee has achieved acceptably competence in a certain list of tasks or has acquired adequate information about certain areas. In such a situation, the examiner needs to give a fair opportunity for the examinee to demonstrate the skill or knowledge gained. If the examinee has been told in advance what is expected, and is examined and graded only on these aspects, then the evaluation will be considered as fair.

Since these descriptions are as different as tomatoes and potatos, why is it that the two forms of evaluation are mixed up? Why do we have school boards attempting to rank students when all we need are grades? When admissions are decided based on ranks, why do we get worked up when candidates who are good are left out even though we do not dispute the quality of those selected?

Most of us know and will acknowledge that the value of any ranking is ephemeral (has a short expiry date!). Arguing over lists of the "ten best ... of all time" is a wonderful pastime, but we should not be serious about it! Yet, we find it being taken seriously.

Part of the reason is that competition is perceived as a spur. From the time when humans were escaping into trees to get away form lions to the more recent race to the moon, we have seen humans achieve more than even they considered possible, when egged on by the competitive ethos. Since we think that ranking (being competitive) can bring out higher levels than grading, we often institute ranking, where grading would be sufficient.

Another reason is nagging self-doubt amongst the educators that perhaps the exam is pitched too low or too high; no honest examiner will ever claim that they have set the "perfect" test! If all the students meet the maximal requirements of a certain grading system, then we feel that we have not demanded enough. On the other hand if most students do not meet our expectations, we feel that we may have been too harsh.

Yet nother reason is that evaluators are aware that their grading will be used competitively! So they feel that clubbing a lot of excellent students in the 'A' category is "unfair" to the outstanding students who should be helped to "stand out".

"Relative" grading (or grading on a curve) is supposed to resolve some of these issues, but has often been seen to come up short. Moreover, it seems to violate the fundamental distinction between ranks and grades. It often creates artificial divisions in order to satisfy a general sense that there should not be "too many 'A's" (or "too many 'F's"!).

It must be obvious that this writer's view is that ranking evaluations should be limited to the settings where such ranking is almost unavoidable. Even in such situations, statisticians have shown that the bulk of the actual rankings (those close to the mean) are not very different from a random ordering and perhaps a "lottery" is more appropriate at the middle (and upper middle) levels.

In all other situations, educators should attempt to honestly classify, in advance, what would constitute a particular grade for a certain examination and then limit themselves to measure and award the appropriate grade, whatever be the form of the resulting distribution of grades.

Sat, 14 Feb 2015

Skills versus Knowledge

Sun, 24 Aug 2014

Frying Pan to Fire

Sun, 01 Jun 2014

Response to a Questionnaire of the NCERT

Mon, 28 Apr 2014

Come back!

Sun, 19 May 2013

Role Playing

Tue, 09 Apr 2013

The Role of Examinations at IISER M

Mon, 25 Mar 2013


Wed, 06 Mar 2013

The Scale of Problems

Fri, 22 Feb 2013

Faculty Members are scared of students!

Thu, 21 Feb 2013

Interdisciplinarity at IISER Mohali

Mon, 11 Feb 2013


Thu, 07 Feb 2013

Examinations and Classes

Thu, 13 Dec 2012

Explanation of Course Structure at IISERM

Thu, 10 May 2012

Are Examinations at IISERM "unfair"?!

Sun, 08 Jan 2012

Simplification in Research and Teaching

Tue, 21 Sep 2010

Can Mathematics be taught?

Wed, 18 Jun 2008

A flipping trick

Tue, 01 Jan 2008

Trying some encouragement

Sun, 16 Dec 2007

The Calculus Trap

Sat, 03 Nov 2007

IISER course structure proposal

Thu, 01 Nov 2007

Some notes regarding the IITB syllabus

Fri, 12 Oct 2007

The Mathematics of the "Kerala School"

Fri, 28 Sep 2007

Defending Mathematical Research

Wed, 04 Jul 2007

Courses of Study

Tue, 08 May 2007

A response to a response

Sat, 24 Mar 2007

"Bramhinism" and research

Mon, 22 Jan 2007

A different crticism of Dawkins

Sat, 21 Oct 2006

A response to a questionnaire

Wed, 13 Sep 2006

Universities vs Polytechnics

Tue, 15 Aug 2006

IISER Mathematics Courses for 2006

Tue, 11 Jul 2006

The Indian-ness of Zero

Wed, 10 May 2006

Mathematics from the pure to the practical

Wed, 02 Nov 2005

What are the IISER's good for?

Wed, 26 Oct 2005

Discussion on IISER's

Wed, 13 Oct 2004

Open Examination for IMSc entrance

Fri, 10 Oct 2003

Computers for 5-year olds

Tue, 16 Sep 2003

List of projects for O/S course

Mon, 07 Apr 2003

TeX for Schools?

Sun, 19 Jan 2003

What are IITs good for


< September 2015
   1 2 3 4 5
6 7 8 9101112

2015, 2014, 2013, 2012, 2011, 2010, 2009, 2008, 2007, 2006, 2005, 2004, 2003, 2002, 2001, 2000, 1999, 1997, 1995,