As I noted in an earlier post of this series, I had been warned, “You will be surprised to discover what your students did not learn.” Though I was surprised, at times, to discover that some examinations revealed a complete misunderstanding of a legal doctrine, what startled me was the discovery that many students struggled with what I call the examination answering process. I compiled a list of process errors as I reviewed examination and assessment answers with students trying to determine what they had done to earn a grade less than the grade they expected or wanted.
Too often, students misread facts. Sometimes the downside is small. For example, using the wrong name for a person identified in the question, such as substituting “Jane” for “Jean,” is harmless if there is no one named Jane. On the other hand, substituting “Jane” for “Jean” can be devastating in terms of grade if there are two people in the facts, Jean and Jane, who engaged in totally different activity. Another example of misreading facts can be illustrated by treating someone as alive who is, according to the facts, deceased. If the facts state that Bob is deceased, an answer to a wills or intestacy question that claims Bob receives or inherits property will not earn any points.
There are time when students do not answer the question that is asked. If the question asks, “Does Richard inherit from Mary?” an answer that states, “Peter inherits from Sally” suggests something is seriously wrong with the student’s approach to analyzing the facts and developing an answer. Sometimes the student shares the reason. More than once I have read an answer that begins, “You asked about the scholarship exclusion, but it’s not clear to me what the answer is, so I will discuss the extent to which the fringe benefit exclusion applies.” Along the same lines, every now and then a student will write, “You asked whether Norman inherits, but because that’s unclear, I will discuss why Peter inherits.” This pattern of changing the question from what is asked to what the student wants the question to be is detrimental. Granted, deflection of that sort happens much too often in litigation and politics, but ultimately it is not good strategy, and it certainly does not help a student do well on an examination.
Similarly, some students enter an examination convinced that a particular topic or issue will be the subject of at least one of the questions on the examination. Fortunately or unfortunately, depending on one’s perspective, it is impossible for an examination to cover every issue addressed in a course if the examination is limited, as they are, to three, four, five, or even six hours. I tell students that there will be topics or issues not covered in the examination, even putting aside topics discussed in the class principally for the purpose of alerting students about issues not within the scope of the class or that were addressed with the “this is not on the examination” assurance. I have had conversations with students after examinations in which they expressed surprise, delight, and even disappointment that a particular topic was not on the examination. “But I knew that topic so well” is the lament of a student who has concluded that his or her grade would have been higher had that topic, rather than some other one, been on the examination. I have seen examination answers that suggest a student tried to fit a discussion about a topic into as many answers as possible, even though that topic was not addressed by the examination, in what I consider to be an attempt to reframe the examination into what the student wants it to be.
A major flaw in writing examination answers occurs when a student does not follow through with his or her thinking process. For example, consider a question that asks if money transferred from an uncle to a nephew is taxable. An answer that states, “If the transfer was in exchange for services performed by the nephew for the uncle, then the transfer is included in gross income,” is flawed because it is incomplete. What if the transfer is NOT in exchange for services? No matter the area of law, any analysis that brings the student to a branching in the logic requires following through on both, or all, branches. It is a reason that mapping out a flowchart before writing the answer is recommended by many law professors.
Many law students are told that the best approach to answering a question is to use “IRAC,” which is an acronym for stating the issue, stating the rule, providing application of the rule to the facts, and stating a conclusion. The problem with that advice is that it confuses the writing of an answer with the thinking that underlies the answer. As I tell students, IRAC is a useful overarching pattern for thinking. But it can be detrimental if used in a manner that conflicts with the question being asked. For example, many of the questions I pose to students on assessments and examinations require them to answer a question, that is, state a conclusion, and then provide reasoning. When I administer semester assessments, I frequently include in the instructions a requirement such as this one: “First answer yes or no, and then provide your reasoning.” Even with that warning, I receive answers that are what I call “thinking/writing out loud.” Sometimes the answer begins with something along the lines of, “You asked whether Jennifer inherits any property from Marissa.” In answering aloud, that sort of “filler” to buy time to organize thoughts has its benefits. But it conflicts directly with what is being asked of the student by the assessment or examination question.
Time management is another contributor to students not doing well on examinations. This is a reason I, and many others, provide suggested time allocations for the questions on the examination. Consider an examination with 20 equally-weighted questions assigned to a 120-minute segment of the examination. It makes no sense to invest 20 or 30 minutes trying to answer the seventh question if the price paid for that decision is running out of time to answer the last four questions, which the student could have, and would have, answered correctly. So I do advise students that if a particular question, independent of the others, stumps them, to skip it, make note to return to it, and to proceed to the next question. One student remarked, “Everyone knows to go first for the low-hanging fruit.” I replied, “You would think, but no, not everyone knows, or at least if they know, they let the excitement and pressure of the moment cause them to forget.”
So as I have learned what sorts of process errors students make on assessments and examinations, I have taken steps to help them avoid these pitfalls. I share with them what sorts of missteps students take, and what not to do. I include instructions that remind students to proceed in a manner consistent with good question-answering practice. I do this because I think teaching law involves more than teaching doctrine.