MauledAgain

For readers who would like an index to the series of posts on sharing Some Thoughts on Teaching Law. Here it is.

Some Thoughts on Teaching Law: Part I: Introduction

Some Thoughts on Teaching Law: Part II: Transactional Curriculum for Doctrinal Courses

Some Thoughts on Teaching Law: Part III: The Problem Method

Some Thoughts on Teaching Law: Part IV: Teaching Ethics

Some Thoughts on Teaching Law: Part V: Team Teaching

Some Thoughts on Teaching Law: Part VI: Balancing Theory with Practical Reality

Some Thoughts on Teaching Law: Part VII: Smaller Classes

Some Thoughts on Teaching Law: Part VIII: Learning Outcomes Measurement

Some Thoughts on Teaching Law: Part IX: Online Education

Some Thoughts on Teaching Law: Part X: Teaching Loads

Some Thoughts on Teaching Law: Part XI: Tenure, Teaching, Scholarship, Service, and Compensation

Some Thoughts on Teaching Law: Part XII: Office Hours, Email, Virtual Classroom Discussion Boards

Some Thoughts on Teaching Law: Part XIII: Flipping the Classroom

Some Thoughts on Teaching Law: Part XIV: Laptops in Classroom

Some Thoughts on Teaching Law: Part XV: Attendance

Some Thoughts on Teaching Law: Part XVI: Formative Assessment

Some Thoughts on Teaching Law: Part XVII: Examinations and Assessments From the Law Professor Perspective

Some Thoughts on Teaching Law: Part XVIII: Examinations and Assessments From the Student Perspective

Some Thoughts on Teaching Law: Part XIX: Learning From Student Examination Errors

Some Thoughts on Teaching Law: Part XX: The Art or Science of Grading

Some Thoughts on Teaching Law: Part XXI: Challenge Examinations

Some Thoughts on Teaching Law: Part XXII: Remediation Semester

Some Thoughts on Teaching Law: Part XXIII: Paying for Law School

Some Thoughts on Teaching Law: Part XXIV: Course Evaluations

Some Thoughts on Teaching Law: Part XXV: In Conclusion, Passing It To the Next Generations

So the starving oligarchs and impoverished investors, struggling to survive with their capital gains being taxed at special low rates, lower than those applicable to wage income, are now begging for indexing of basis in their investments. Worse, because they know that Congress isn’t going to hand them yet another tax break, they are pressuring the Executive Branch to usurp Congressional power and impose indexing by executive order.

The principal justification for special low rates on capital gains is that those rates compensate for the failure to index basis. The argument is that a portion of the gain reflects inflation rather than a “true” increase in economic wealth. I agree. I agree that the basis of capital assets should be indexed for inflation. But, that removes the justification for the special low rates on capital gains. To have both is to be greedy, and to succumb to the money addiction that is destroying the nation. Or perhaps it is part of an even nastier plot.

Perhaps my thoughts that I shared in this series about teaching law have been of interest to those who have read them. Perhaps they were a revelation to someone who has not attended law school. Perhaps they were a surprise to a student who was enrolled in one of my courses, or at least a better or more easily understood explanation of some of what transpired in the course. Perhaps former or current colleagues found these thoughts to be alarming, or ridiculous, or amusing, or helpful. Perhaps former students who are now members of a law faculty can examine what I wrote, meld it with what they experienced and observed while sitting in one or more of my courses, conclude that they could improve on what I have done, and incorporate it into their teaching. Perhaps they, some day, will in turn pass their thoughts on, to their students who eventually enter the ranks of law teachers.

As a student, and as a law professor, I watched, listened, conversed, studied, and thought about what was involved in teaching law. Several of my law professors mentored me not only in the courses they taught, but also in my development as a law professor, because it was no secret that they planned to bring me back, and they did. Many of my law professor colleagues taught me, guided me, shared ideas with me, advised me, challenged me, argued with me, and otherwise influenced me and my law teaching. I mixed all of that with my own ideas, with ideas from friends and relatives who taught in other disciplines, with memories of what I had experienced from those who taught me before law school, both in the institutional setting and as mentors outside of school, and with suggestions, proposals, and reports in articles written by law faculty and teachers in other disciplines who I never met in person. The concoction that resulted, though changing over the nearly 40 years I have devoted to teaching law, ended up defining me as a law professor. Though there are one or several courses left for me to teach, my thoughts have reached the twilight of their progression. They can live on in the minds of those who want to remember them.

When all is said and done, most law schools give their students an opportunity to evaluate the courses in which they are enrolled. For me, the course evaluation process presents three significant concerns.

The first concern involves the questions that are asked. Fortunately, over the years, improvements have been made in the nature of the questions posed to the students. For example, no longer do the evaluations at the law school where I teach ask if there was a syllabus. There are much easier ways to determine if the person teaching the course has complied with the requirement that a syllabus be distributed to the students. As another example, there is no need to ask all of the students whether any classes were cancelled or if the professor failed to show up for a class. That information reaches the administration through other means, and so that question disappeared. But there still remain some questions that could be improved or perhaps eliminated, and there are questions that could be added. Recently, the law school where I teach has amended the evaluation form to permit faculty to add questions. So, in time, I think this first concern of mine will disappear.

The second concern involves participation rates. Law schools take all sorts of steps to encourage student responses, including making it easier to fill out an evaluation using the school’s web site. To move beyond encouragement to full participation, law schools would need to do what is done to get full responses to questions that matter for accreditation purposes, such as employment information. For example, diplomas are handed over only after the employment information is provided. Why does participation matter? Without a full canvass of the class, the evaluations tend to be those provided by students who are overjoyed with the course or, more likely, those who are angry for some reason, perhaps because they didn’t bring their full attention to the course. One need only examine independent online course and faculty evaluation sites to realize how skewed, inaccurate, and silly evaluations can become when they are do not represent a full cross-section of the class. Though these misleading websites aren’t going to disappear, law school administrations don’t pay attention to them, but it will not take very much to get full participation.

The third concern is the one that is most troubling. As a general proposition, a course, like a restaurant, a movie, or a business deal, cannot be fairly evaluated until it is completed and its effects can be observed or experienced. True, there are times when something about the meal, movie, or business negotiation justifies walking out early and rating the experience as awful. But in many instances, it’s only after dessert, or a great dramatic ending, or a longer-term profit that an evaluation is worthwhile because it takes into account the entire experience. I cannot count the number of times a former student, several or more years after graduation, has encountered me at an event and shared an opinion that can be summed up thusly: “I thought you were a jerk and I hated you and the course, but now that I’ve been in practice I realize what you were doing, and it has made a difference, it has made me a better lawyer.” Colleagues have had similar reactions, and the fundraising office also has relayed similar anecdotes. For years I have advocated asking graduates to do evaluations a few years after graduation, but that proposal has never gained traction. Cost, which once was an issue because it would have required postage, no longer is an impediment, thanks to digital technology. The biggest challenge is the participation rate, even taking into account graduates who cannot be found or who are no longer practicing law. The response might resemble the hit-or-miss outcomes of the independent websites offering forums for evaluations. But is there any harm in trying, to see what happens? Perhaps something more formal can be incorporated into the communications between graduates and alumni and development offices.

Though it is one of the first things prospective law students consider, I have left the question of financing law school to near the end. Teaching law can happen only if law schools have sufficient funds to pay a faculty and staff, maintain facilities, and operate programs. Over the past several decades, the costs have increased not only because costs in the economy have increased generally but also because law schools have had to add technology, which isn’t inexpensive, and programs, such as those designed to provide remediation.

Law schools obtain funding primarily from three sources. One is tuition, another is donations, and the third is endowment income. Donations come from graduates, from private sector third parties interested in the programs of a law school, and occasionally from government. Private sector donations often arrive with strings attached, sometimes necessitating the creation of a new program while existing programs are financially squeezed. In theory, law schools with large endowments can reduce tuition from what it otherwise would be, but endowment earnings fluctuate and can be unpredictable.

During the past decade, a law school’s stated tuition has become akin to a car manufacturer’s suggested retail price. Few, if any, pay that amount. Instead, law schools offer discounts, scholarships, and occasionally loans. Where do law schools obtain the funds to do this? Donations help, as do endowment earnings, but a good bit of the tuition reductions reflect what is paid by students getting little or no tuition reduction. This approach to law school financing cannot continue. There is little dispute among law school administrators and faculty, and among university finance officers, that something needs to be done.

Though donations from graduates are helpful, very few law schools experience high levels of graduate participation in donations. Donations from graduates who received financial assistance of one sort or another isn’t materially different from donations from graduates who did not. Nor is there a strong correlation between a law graduate’s financial status and the amount of giving. Some graduates who make a modest living are loyal donors, and some graduates who have done very well give nothing. Unfortunately, graduates who head out after graduation unhappy with something about, or someone at, the school often cut off subsequent contact. No school expects all or even most of its graduates to participate in annual giving or some similar program, even though every school wishes that it had 100 percent participation.

What I think could work is a mechanism to establish law graduates as part of the law school’s financial health. Though discounts are helpful in attracting students, they don’t necessarily instill in a student a sense of giving back. The recipient of a scholarships or grant from the school might be a bit more likely to donate, but giving back is far from a sure thing. Why not instead shift from discounts and scholarships to loan programs?

Law schools have had loan programs and the experience has been mixed. Too many loan recipients do not pay back the loans. Law schools have been reluctant to play the role of bill collector, or to damage goodwill by turning loans over to collection agencies. Yet in many instances the lack of repayment simply reflects the weak financial condition of the loan recipient. Would it not make sense to connect the amount and timing of loan repayments to the income and wealth status of the loan recipient? By doing so, the law school is investing in the futures of its graduates, and has an increased incentive to teach them well, to guide them in their educational endeavors, and to be supportive of them as they develop their careers. Law students and law school graduates often complain that the school “doesn’t care,” and though I don’t think that is true, a loan program of this sort would make the law school’s caring about its students and graduates more visible. It also recycles the loan dollars, with interest, so that a donation of a particular size can support many more students than it would if it were simply distributed as scholarships.

It’s worth a try, is it not? What is there to lose?

The flip side of the challenge examination is what I call the remediation semester. It’s not something I’ve ever proposed, because it probably would dissatisfy administrators, faculty, and students. It addresses what I perceive to be a set of increasing problems.

Law students arrive on the first day of law school from a diverse array of educational backgrounds, both in terms of quality and in terms of subject matter exposure. In many ways, there are significant benefits to having a classroom in which a veterinarian, a history major, an accountant, a computer science major, a police officer, a theology major, an engineer, and a geology major can engage in discussions about legal issues. Having multiple perspective enriches the law school education experience.

Yet there are drawbacks to these differences. Students who have progressed through educational systems that are not up to par face a steeper climb to law school success. It’s not their fault that they attended underfunded or de facto segregated schools, as has been the experience of at least several students who were in my classes, and those are only the ones who shared their education stories. Law schools try to help students in these situations “catch up” by offering programs delivered in the summer before they enter law school, by offering programs available to students who need remedial assistance during their time in law school, by hiring professionals to help students ameliorate basic grammar and other writing deficiencies, and by assigning mentors and tutors or assisting in the retention of tutors.

Students who have majored in certain subjects have advantages that create a background gap between them and their classmates. The flow of discussion becomes interrupted, or at least causes some students to tune out, if attention must be given to help students without a certain background “come up to speed,” especially when assigning supplemental readings or videos isn’t effective for various reasons. Students who major or have backgrounds in certain disciplines have a head start in thinking in the ways those teaching law are trying to help students incorporate into their intellectual analyses.

It’s not so much that students who major in certain subjects have an overall edge compared to their classmates. The advantage that a particular student gains in terms of background knowledge by majoring in a particular discipline is offset because that student did not major in a discipline that a classmate pursued and that gave the other classmate an advantage in structuring a thinking process. It would be wonderful if law schools could dictate a set of prerequisite undergraduate courses, though not majors, in a way similar to the organic chemistry requirement that bedevils pre-med students. Law schools hesitate, though, for two reasons. One, which I understand, is that imposing such a requirement would reduce the number of applicants, an outcome that would be harmful, if not fatal, to the financial position of law schools, both in terms of numbers of tuition-paying students and in the quality of students. The other, which I hesitate to accept, is the idea that law schools can teach anyone to become a lawyer no matter the person’s previous education provided the person has sufficient intellectual capacity.

Attempts to compensate for what I call the subject background gap have produced a variety of approaches. Some schools create mini-courses to fill in basic principles from other disciplines. In some instances, these courses are optional. In other instances, they are mandatory for students who lack an educational background in the content of the course. In still other instances, the courses are mandatory for all students, with no waiver and no challenge examination pathway to waiver, with the rationale being the value those students bring to their classmates. Some schools offer full-fledged courses with titles often ending in “for Lawyers” in order to provide a means of filling in the gap. More recently, law schools are turning to the resources available in the rest of the university, finding ways to permit law students to enroll in courses that can enhance and enrich a law student’s understanding and appreciation of the activities or transactions that generate the need for a lawyer to help prevent or solve a problem.

As helpful as these various remediation techniques are, unless they are offered at the outset, they are of no help to the student while enrolled in courses during semesters before the remediation experience is available. Would it not make sense to set up the first semester with remediation courses and projects, of varying lengths? Or perhaps, to set up something available in the summer before law school, as Harvard Law is starting this summer. That semester (summer or fall of the first year) could also include other preparatory courses such as Legal Writing, as well as one or two substantive courses least likely to be affected by education background gaps. Combined with challenge examinations, the entire law school experience could be increasingly personalized, with students finishing in anywhere from five semesters to eight semesters. Already there are students who take summer courses and thus could graduate in five semesters if it were permitted, which it is not. And there are more than a few students who because of leaves, or the need to earn additional credits, take seven or eight semesters to graduate. There is room here for law schools to explore even more possibilities as legal education moves away from the decades-ago model of a one-size-fits-all three-year experience.

One of the complaints about present day legal education is that law school takes too long to complete, and that shortening the length of the program would reduce law school tuition, the level of which is another complaint about present day legal education. Though I disagree that three years is too long, I do see a way of shortening the time a student spends in law school, though perhaps it would only eliminate one semester.

Why not permit students to obtain law school academic credit by taking and earning an A level grade on a challenge examination? Though I doubt very many students would succeed, it makes sense to provide the opportunity so that the few who would benefit could do so. Surely there are, for example, students who majored in business or accounting who could do well on a basic tax examination. There might be librarians who could excel on a Legal Research examination. In the long run, the existence of challenge examinations might entice undergraduate programs to offer law courses, perhaps taught by faculty at an affiliated law school, for which law school credit could be earned. I’ve always thought it would make sense, and in many ways be cost-effective, to offer a section or two of the basic tax course or the business organizations course in the business school. Why not offer a section of criminal procedure in an undergraduate criminology program? Why not offer a section of intellectual property law in an undergraduate computer science program? The course would enrich those programs, and for graduates of those programs who decide, at that point or later in their careers, to attend law school would save time and money.

The idea of law school challenge examinations popped is not a new one, nor is it mine alone. My first consideration of the idea occurred several decades ago, when a student in the M.T. program asked permission to take an advanced J.D. tax course without having had the prerequisite course (because he was not a J.D. student). We, that is, myself and those with the final decision-making power, decided to let him do so. The student struggled. At that point, I suggested that in the future a student be permitted to skip a prerequisite course only if the student earned an A on a challenge examination. The particular situation in question never again preseneted itself to me, but it did start me thinking about challenge examinations more thoroughly.

For as long as there have been American law schools, grades have been the subject of numerous and sometimes intense faculty discussion and a source of much distress, glee, and bewilderment for law students. Rumors about grading that circulate among law students range from those that raise concerns to those that are laughable. Never, for example, have I known a law professor to toss examinations down the steps and base grades on where the examinations landed.

When students ask me how I determine grades, I tell them. Years ago, in an effort to avoid fielding and answering that question multiple times each semester, I decided to share with students how I grade. Not only do I provide the basic information faculty now are required to provide, such as whether the grade is based on one or more examinations or papers and whether examinations are open-book or closed-book, I also explain how I translate student assessment and examination performance into a final grade. What I do is not a secret.

The final grade in my courses, other than the occasional seminar or similar course I have taught from time to time, is based on a combination of performance on semester assessments and a final examination. The semester assessment score constitutes one-third of the grade and the final examination constitutes two-thirds. In recent years, there have been ten semester assessments. Some, usually four or five, are assigned for completion outside of class. The others, usually five or six, are administered in the classroom, using student response system software. Because a student might be absent from class on the day that a semester assessment is administered, and because there is no administrable way of providing a make-up assessment, the two lowest semester assessment scores are dropped. Though I could limit the dropped scores to scores earned from in-class assessments, I permit dropping scores from out-of-class assessments because there might be a good reason for a student to fail to provide a response even though they are usually give four or five days to send an answer. The combination of the semester assessment total score and the examination score is a matter of simple arithmetic.

I grade against a standard. There is a model answer for each question. For a multiple-choice questions, the model answer is the correct selection. For a true-false question,. the model answer is the correct response accompanied by correct reasoning. One without the other does not earn credit. For short-answer questions, the model answer is what I would have answered, with points assigned to each component of the answer. For example, a semester assessment might ask a student to identify four facts that need to be determined in order to resolve the client’s problem, or to identify four questions that need to be asked of the client. A student who provides three correct facts or questions earns three-fourths of the maximum score for that assessment. A student who provides a correct response that is not in the model answer earns credit for that answer.

Thus, there is a total maximum possible score for the course. Grades reflect the percentage of that score that a student has earned. Over the years, discussions with law faculty, including those who taught me, and careful consideration of articles written about grading have shaped my decisions with respect to those percentages. A student who demonstrates he or she has learned at least something, particularly very basic concepts, ought not fail. Thus, a score that is 20 percent or more of the maximum possible score earns at least a D. On the flip side, a student whose score is at least 80 percent of the maximum possible score earns an A, which is the highest grade. Other grades fall in-between. The precise cut-off point can shift so that there is not a one point difference between one grade and another. I also re-grade examinations that earn low grades of F, D, and C minus, and those examinations that are close to the cut-off point for each grade.

I grade against a standard. I do not use a grading curve. The debate about grading curves is a long and interesting one. Why do I grade against a standard? My goal in teaching law is to prepare students for law practice. The standards that I set for the course, which dovetail to what can be called learning outcomes, are intended to match what a student ought to be able to understand, explain, and do with respect to what is covered in the course. The question that needs to be answered is whether, and if so, to what extent, has the student achieved the course standards? Students who demonstrate an accomplishment at the level of a particular grade earn that grade. The idea of telling a group of students who have demonstrated mastery of a course that only some of them will be awarded a grade of A because there are a limited number of A grades to be awarded makes no sense to me in the context of measuring preparation for the practice of law. It makes sense that there are a limited number of medals awarded in an Olympic competition, but those events involved athletes competing against each other, whereas students in a course are striving to attain an accomplishment measured by a standard and ought not be competing with each other, aside from moot court and similar competitions.

Students think that law professors “give” them grades. I have explained to students, many times, that I do not give grades. Students earn grades. Years ago, a colleague expressed surprise at the idea a student could “earn” an F grade. My response remains the same. It is the equivalent of telling someone, “You have earned nothing.” That is what I would say to someone hired to mow the lawn, who doesn’t show up, but demands to be paid. Yes, it is possible to earn nothing and possible to earn an F. Fortunately, the earning of an F has been a very rare occurrence in my courses. May it stay that way.

As I noted in an earlier post of this series, I had been warned, “You will be surprised to discover what your students did not learn.” Though I was surprised, at times, to discover that some examinations revealed a complete misunderstanding of a legal doctrine, what startled me was the discovery that many students struggled with what I call the examination answering process. I compiled a list of process errors as I reviewed examination and assessment answers with students trying to determine what they had done to earn a grade less than the grade they expected or wanted.

Too often, students misread facts. Sometimes the downside is small. For example, using the wrong name for a person identified in the question, such as substituting “Jane” for “Jean,” is harmless if there is no one named Jane. On the other hand, substituting “Jane” for “Jean” can be devastating in terms of grade if there are two people in the facts, Jean and Jane, who engaged in totally different activity. Another example of misreading facts can be illustrated by treating someone as alive who is, according to the facts, deceased. If the facts state that Bob is deceased, an answer to a wills or intestacy question that claims Bob receives or inherits property will not earn any points.

There are time when students do not answer the question that is asked. If the question asks, “Does Richard inherit from Mary?” an answer that states, “Peter inherits from Sally” suggests something is seriously wrong with the student’s approach to analyzing the facts and developing an answer. Sometimes the student shares the reason. More than once I have read an answer that begins, “You asked about the scholarship exclusion, but it’s not clear to me what the answer is, so I will discuss the extent to which the fringe benefit exclusion applies.” Along the same lines, every now and then a student will write, “You asked whether Norman inherits, but because that’s unclear, I will discuss why Peter inherits.” This pattern of changing the question from what is asked to what the student wants the question to be is detrimental. Granted, deflection of that sort happens much too often in litigation and politics, but ultimately it is not good strategy, and it certainly does not help a student do well on an examination.

Similarly, some students enter an examination convinced that a particular topic or issue will be the subject of at least one of the questions on the examination. Fortunately or unfortunately, depending on one’s perspective, it is impossible for an examination to cover every issue addressed in a course if the examination is limited, as they are, to three, four, five, or even six hours. I tell students that there will be topics or issues not covered in the examination, even putting aside topics discussed in the class principally for the purpose of alerting students about issues not within the scope of the class or that were addressed with the “this is not on the examination” assurance. I have had conversations with students after examinations in which they expressed surprise, delight, and even disappointment that a particular topic was not on the examination. “But I knew that topic so well” is the lament of a student who has concluded that his or her grade would have been higher had that topic, rather than some other one, been on the examination. I have seen examination answers that suggest a student tried to fit a discussion about a topic into as many answers as possible, even though that topic was not addressed by the examination, in what I consider to be an attempt to reframe the examination into what the student wants it to be.

A major flaw in writing examination answers occurs when a student does not follow through with his or her thinking process. For example, consider a question that asks if money transferred from an uncle to a nephew is taxable. An answer that states, “If the transfer was in exchange for services performed by the nephew for the uncle, then the transfer is included in gross income,” is flawed because it is incomplete. What if the transfer is NOT in exchange for services? No matter the area of law, any analysis that brings the student to a branching in the logic requires following through on both, or all, branches. It is a reason that mapping out a flowchart before writing the answer is recommended by many law professors.

Many law students are told that the best approach to answering a question is to use “IRAC,” which is an acronym for stating the issue, stating the rule, providing application of the rule to the facts, and stating a conclusion. The problem with that advice is that it confuses the writing of an answer with the thinking that underlies the answer. As I tell students, IRAC is a useful overarching pattern for thinking. But it can be detrimental if used in a manner that conflicts with the question being asked. For example, many of the questions I pose to students on assessments and examinations require them to answer a question, that is, state a conclusion, and then provide reasoning. When I administer semester assessments, I frequently include in the instructions a requirement such as this one: “First answer yes or no, and then provide your reasoning.” Even with that warning, I receive answers that are what I call “thinking/writing out loud.” Sometimes the answer begins with something along the lines of, “You asked whether Jennifer inherits any property from Marissa.” In answering aloud, that sort of “filler” to buy time to organize thoughts has its benefits. But it conflicts directly with what is being asked of the student by the assessment or examination question.

Time management is another contributor to students not doing well on examinations. This is a reason I, and many others, provide suggested time allocations for the questions on the examination. Consider an examination with 20 equally-weighted questions assigned to a 120-minute segment of the examination. It makes no sense to invest 20 or 30 minutes trying to answer the seventh question if the price paid for that decision is running out of time to answer the last four questions, which the student could have, and would have, answered correctly. So I do advise students that if a particular question, independent of the others, stumps them, to skip it, make note to return to it, and to proceed to the next question. One student remarked, “Everyone knows to go first for the low-hanging fruit.” I replied, “You would think, but no, not everyone knows, or at least if they know, they let the excitement and pressure of the moment cause them to forget.”

So as I have learned what sorts of process errors students make on assessments and examinations, I have taken steps to help them avoid these pitfalls. I share with them what sorts of missteps students take, and what not to do. I include instructions that remind students to proceed in a manner consistent with good question-answering practice. I do this because I think teaching law involves more than teaching doctrine.

As a general proposition, students do not like examinations and assessments. Most students understand they are necessary, but do not look forward to the experience. Many students dread examinations and assessments. During the final examination period at law schools where I have taught, the atmosphere dripped with anxiety. Though I repeatedly tell students that assessments and examinations are intended as “snapshots” to see where they are at the moment with respect to the course, the reaction usually is one of worry about failure or not obtaining a desired grade rather than, especially in the case of semester assessments, “let’s see where I am and what I need to do to improve.”

At the beginning of the semester, in every course, I share with students my advice for doing well in the course, including semester assessments and final examinations. I suggest that they focus on pre-class preparation, in-class learning methods, and post-class assimilation. I recommend that they do the assignments before class in the order presented in the syllabus. I explain that effort matters more than outcome, and that no effort is far worse than a failed effort, because a student can learn from making a failed effort. I emphasize how essential it is for students to do the reading and attempt to do the problems before class. I explain that while they are in the classroom their goal is to acquire comprehension and understanding, and not simply to gather information. I also stress the importance of devoting time after class to preparing summaries that are their own work product, because the creation of outlines, charts, graphs, or any other sort of summary is of much higher value as a learning process than simply reading something another person has prepared. I compare the difference between riding a bicycle and watching someone else ride a bicycle in the context of trying to get beneficial physical exercise. I encourage students to help others learn, because the process of teaching is one of the best ways to learn. I explain that students who do these things almost always do better on assessments and examinations than they otherwise would, and that one of the goals of semester assessments is to discourage students from leaving everything until the end of the semester.

At the end of the semester, in every course, I share with students my advice for final examination preparation. It makes no sense to stay up all night, focusing on one or two issues, because the lack of sleep is counterproductive, and the worry about those one or two issues will distract students while they are taking the examination. I emphasize the need to stay healthy, eat properly, continue engaging in physical exercise, and getting sufficient sleep. I advise them to avoid, where possible, what I call “externalities,” namely distractions arising from situations and events from other parts of their life, as, for example, the night before an examination is not a good time to get into a discussion about wedding plans. I then share with them a story. When I was a law student, one of my then professors who later became a colleague advised me to go to the movies the evening before the examination in his course. I told him that he had just proven what many students had said about him was true, that he was crazy. He laughed. Years later, after I had joined the faculty, I began to figure out that he was absolutely right. I told him. He smiled. I think he took some delight in having been called crazy. It is a crazy idea. I explain to my students that it is important to give the brain time to absorb, organize, and put into memory what the student has been reviewing, that engaging in mindless activity helps the brain do this, and pushing the brain to review until the early morning hours is much like running a practice marathon the day before a marathon. I note that the mindless activity need not be a movie, but it needs to be something that occupies the mind in a manner that distracts the brain from focusing on the course material.

Every now and then a student will tell me, after grades are released, that he or she followed my advice even though they thought I was a bit crazy. I laugh and ask them if they remember the story I had shared. They laugh. In this respect the cycle of law teaching continues.

When I was a law student and discussions took place about bringing me back to teach law, one member of the law faculty, trying to provide a full disclosure about the prospect, shared with me what he considered to be the two most burdensome aspects of being on a law faculty. One was faculty meetings, which ended up not being all that horrible. The other was preparation and grading of examinations. Though preparing and grading examinations and assessments is not horrible, it is challenging and at the same time rewarding and disappointing.

Preparing examinations and assessments is challenging because questions need to be drafted carefully so that they can be answered. Open-ended “who can sue whom for what” questions might not give raise enough issues to provide students with a sufficiently wide range of opportunities to demonstrate what they learned. Multiple choice questions need to be designed so that there is only one correct answer, and not zero or two or more correct answers. True-false questions need to be crafted so that the proposition is true or false under all circumstances and not sometimes true and sometimes false. The range of questions on an examination, or on the combination of semester assessments and the final examination need, to be a fair representation of what was covered in the course. The coverage needs to be balanced in order to avoid making a large portion of the grade dependent on a topic that was explored for only a small portion of the semester. Otherwise, a student who has done well learning the course material but for the one topic will end up with a grade that does not fairly represent the student’s accomplishment. The questions on an examination, or on the combination of semester assessments and the final examination, need to of varying difficulty, to give students opportunities to show that they learned something, mastered the material, or ended up somewhere in-between.

Grading examinations is challenging for several reasons. Until the advent of examination software that generates printed answers, reading handwritten responses sometimes is near impossible. Examination software has its flaws, which I won’t detail at this point, but most of the flaws are a matter of logistics or inconvenience rather than response validity. Grading examinations often is tedious, particularly in high enrollment courses.

Grading examinations often is disappointing. The disappointment arises from the realization students did not learn as much as they ought to have learned. As I was warned, “You will be surprised to discover what your students did not learn.” The use of semester exercises has softened this disappointment, especially as it provides a method for getting students on track sooner rather than later. The disappointment can be exacerbated when a wrong answer, rather than simply being a matter of a student missing a fine point on one or more of the challenging questions, is a statement that reveals that the student somehow missed basic concepts repeatedly visited throughout the semester.

Grading examinations often is rewarding. For example, an examination that achieves 85 to 99 percent range of the maximum possible score, though perhaps being more a reflection of the student’s talent and efforts and not so much the professor’s teaching ability, reinforces the belief that it indeed is possible for students to earn high scores. As another example, when it turns out that all of the grades are passing grades or, better, all of the grades are above a C-minus, or even better, many of the grades are in the honor range, the same sense of success is felt. Contrary to what some students think, law faculty want their students to do well, and aren’t trying to write examinations designed to generate low scores. We want students to learn, and the better that students perform on examinations and assessments, the more pleased we are.

For decades, the pattern of determining grades in most law school classes was the administration of a final examination. In seminars, the grade rested primarily on a paper. In Trial Practice, clinics, and similar courses, the grade reflected a subjective evaluation of student performance.

Rarely, if ever, did a student obtain feedback on whether the student was making satisfactory progress through the semester. Often, professorial reaction to classroom participation did not reveal if the student was on track or way off base. As a consequence, students who did not acquire the requisite understanding would enter a final examination without realizing that they were destined to do poorly.

When I started teaching law, one of my former law professors turned colleague warned me, “When you grade the final examination, you will learn how much the students did not learn.” That startled me, because I had always approached teaching -- I had done teaching and tutoring throughout my school years -- with the goal of maximizing what students learned. It became even more troublesome when, after sitting down with students unhappy with their grades, I realized that students often did poorly because the same error in thinking or other bad intellectual habit permeated their examination answers. Too many times a student would say to me, “I wish I had known this before the exam.” It only took several semesters of this experience to decide to do something to change the pattern.

I decided to implement the same sort of testing-and-feedback approach that I had experienced in my elementary and high school education. Daily and weekly tests were the norm, not the exception. Students on the wrong track could be helped to reorient themselves before they wandered too far afield. Perhaps to the surprise of many, to do this I needed to obtain faculty permission. Suffice it to say that it was granted over strong opposition. Some saw my proposal as an attempt to help students prepare for the examination. Others worried that students would devote more time to my course, and less time to their other courses, if they knew that a graded exercise was scheduled, so the approval of my proposal included a requirement that graded exercises be unannounced. Student reaction evolved from initial annoyance at the beginning of the semester to appreciation by the end of the semester. I designed the exercises to give students an opportunity to learn not only substantive law but also to understand how their reading and thinking processes did or did not help them properly analyze and answer a question.

Twenty years after I began what is now formative assessment, law schools began to respond to practitioner complaints about the insufficient readiness of law school graduates for law practice by exploring the idea of adopting formative assessment. I remember being told more than several times as the discussion of formative assessment proposals was underway, “You’ve been doing this for years. Tell us about it.” What I shared did not necessarily delight others. “It’s a lot of work. Questions need to be designed, and then graded. I provide an analysis that I share with the class, in which I share my model answer, and explain what was wrong with each erroneous response offered by students.” Each semester requires the design of new questions. The offset, though it probably is only a partial offset, is reduction of the size and time allotment for the final examination, which reduces the time needed to grade that final examination.

The big question is, “Does it work?” The answer is “Absolutely.” For example, one of my favorite types of assessment question is the “What additional facts do you need to obtain from the client?” Students who encounter this type of question for the first time on a final examination often struggle with it. By giving students one or two questions of this type during the semester, along with feedback, I allow them to learn what they are doing correctly and what they need to refine or reform, so that when they get to the final examination, they are in a better position to do well. So, yes, in some respects I am preparing students for the final examination, but in reality I am preparing them for practice, because the final examination, designed well, prepares students for practice. How? To quote one of my former professors turned colleague, “Examinations are learning experiences.” Indeed they are, and by spreading that experience throughout the semester rather than leaving it all until the end, a teacher increases the chances of students acquiring a better understanding than they otherwise would achieve.

Some courses, by their very nature, necessarily include formative assessment. The courses in Legal Writing require students to turn in assignments throughout the semester, which are graded and returned. In courses like Trial Practice and clinics, students are given feedback almost continuously, though usually without specific grades or scores assigned to each aspect of what a student does. The standards for seminars require at least an outline and a first draft, on which the professor comments in order to provide feedback and guidance. It is not surprising, therefore, to see that the grades in these courses usually are higher than those in other courses. It’s another indication that assessment and feedback throughout the semester indeed works.

Formative assessment, despite being championed by the American Bar Associations and some practitioners and faculty, has not yet become the norm. In some courses, faculty have added a mid-term examination. In others, , faculty have added three or four assignments throughout the semester. I am unaware of any courses where I teach, or elsewhere, in which students are presented with ten exercises throughout the semester, other than the courses I have taught and the one I am teaching.

There is one more advantage to formative assessment and feedback throughout the semester that I ought to point out. Not only does it give students a better degree of confidence in their ability to learn and adjust their studying patterns, it also reduces examination anxiety. Students enter the examination period knowing what they have accomplished, and knowing that not everything about their grade rests on their examination performance. In fact, most students know that no matter what they do on the examination, they are not going to fail the course or earn one of the very low passing grades. Reduction of examination anxiety, a particularly intense cause of poor examination performance, increases the chances of a better examination performance than might otherwise occur.

The American Bar Association requires, as part of its accreditation standards, that law schools adopt, publish, and adhere to sound academic standards, including those for regular class attendance. Law schools have enacted an assortment of attendance rules, some of them so fuzzy that it seems impossible to predict what is required, and others so precise that a particular number of absences causes exclusion from the course. At law schools with attendance rules that necessitate the taking of attendance during each class, the responsibility for doing so almost always rests on the faculty. The days of someone from the administrative offices coming into the room to compare who is in the room with a seating chart, as was the case during my first year of law school, are pretty much long gone.

My views on attendance differ from what the ABA and law schools mandate. Though I question the wisdom of attendance policies, I have complied and continue to comply with those that are in place wherever I have taught.

Why do I object to the requirement of attendance?

First, I question one of its rationales. Presumably, the requirement exists so that law degrees are not awarded to students who did not attend class. If a student, though, can attain adequate grades despite not attending class, ought not the student earn the degree? The answer, I think, is that classes ought to be taught in a manner that makes attendance critical to earning a grade sufficient to contribute to the required grade point average for graduation.

Second, I disagree with another of its rationales. The notion that to let students miss class and perhaps risk not graduating while at the same time collecting tuition from them is somehow wrong makes no sense. Students choose to enroll and pay tuition. If they don’t wish to collect what they’ve purchased, that is a choice for them to make. A person who purchases a ticket to a movie isn’t compelled to attend, and doesn’t otherwise face adverse consequences from the theater. Is it the law school’s responsibility to act as the student’s parent?

Third, compelling a student to attend class doesn’t mean the student will be mentally present. Physical presence alone means little or nothing. Aside from illness and other emergencies, students who fail to attend class do so because they dislike the course, dislike the professor, are uninterested in the material, or have a psychological issue of some kind. Compelling attendance does nothing to get to the root of the problem.

Fourth, what mechanisms are effective in compelling attendance? If a student who has too many absences is excluded from the course, isn’t that result inconsistent with one of the purposes for the rule? If the student is required to do make-up work, doesn’t that put a burden on whomever needs to design the assignment, and supervise its completion? If the student’s grade is reduced, does that not send an erroneous message to those who rely on the student’s transcript to make hiring and other decisions, considering that it understates the student’s course achievement and neglects to reveal the student’s failure to attend a sufficient number of classes?

Yet, though I disagree with the idea of compelling attendance, I do recognize the need to pay attention to situations in which a particular student is absent for more than a few classes in a row. When someone in the classroom, whether the professor or other students, notices that someone has been absent, it is wise to notify the administration so that someone with the proper authority can check on the welfare of the student. This, however, can be done without the distraction of attendance sheets being passed through the room, and the additional burden of administrators maintaining attendance spreadsheets.

For me, once the student response (or clicker) system became available, taking attendance was almost effortless. It simply required that there be at least one question during a class that required student responses through the software. Because the number of questions posed during a class were far more than one, attendance was taken automatically. Out of consideration for students who face adverse consequences for missing class, I always made certain that on at least one question every student responded, by taking a moment to remind them that failure to answer could result in being charged with an absence. Interestingly, attendance patterns in my courses before the attendance rules were strengthened and seriously enforced and after those changes did not vary, other than putting an end to the existence of an occasional “phantom” who failed to attend any classes.

Another transformative development that changed the law teaching atmosphere was the invention of the laptop computer. When a laptop first showed up in a law school classroom, it was a novelty. One or two students with backgrounds in computer science or simply with an interest in electronic equipment would bring in laptops. In one course that focused on the relationship between the practice of law and digital technology, an interesting discussion ensued that focused on whether the PC or the MAC was the better choice.

The novelty quickly became a norm, to the point where a student without a laptop was an anomaly. For me, students bringing laptops offered advantages. Students could take notes more quickly, could view visual materials more easily than squinting at what at that time were small, distant, and otherwise inadequate screens, could then transform their notes into outlines and other study guides, and if beset by certain learning or other disabilities, could use the laptop as a remediation. But it wasn’t long before some law faculty began complaining about laptops. The primary objection was that laptops were distractions. Hundreds of articles and commentaries, dozens of studies, and numerous in-person conversations illustrated the zealousness with which those on each side of the debate held their ground.

I explored this issue more than 13 years ago in To Allow Laptops or Not to Allow Laptops: That is the Question Most of what I wrote continues to be determinative for me. Though faculty have the academic freedom to ban laptops, I do not think doing so is wise. Distractions existed before laptops were brought into the classroom, and the banning of laptops does not eliminate or even reduce distractions. When I was a student, and early in my law teaching career, I encountered or became aware of students who played bingo, passed notes, did crossword puzzles, circulated sports betting pool sheets, and played cards. A student using a laptop for activities not related to the class can distract other students, but a student passing a note or doing a crossword puzzle is no less of a distraction.

What causes the distraction is not the laptop, or the note passing. It’s the inattentive, unprofessional, and immature student who causes the distraction that presents a challenge not solved by banning laptops. Direct intervention, whether it is a reaction to a student doing a crossword puzzles or engaging in online shopping, is necessary when the distraction is disruptive. Faculty have intervened in the past and will need to do so in the future. The few times I intervened, the effect was not only to end the distracting behavior but to reduce future instances of such behavior in that course for the semester. Perhaps lowering the grade of a student who causes too much distraction, however measured, would have a much more powerful impact and generate less adverse reaction from students prohibited from using laptops.

There are ways to prevent student laptop use from causing distractions. The key is to keep the students so busy with the class that they don’t have time to play games or shop online during class. When students know that the next set of student response questions might be projected with a “this is being graded” alert, it becomes risky to get into distracting behavior when the next moment might bring a graded exercise. Some faculty might find calling on students to be effective in holding their attention. Moving through the material at a brisk pace energizes the environment. Using visuals, such as pictures related to a case, keeps students focused.

What causes students to engage in distracting behavior, with or without laptops, isn’t the passed note or the laptop. It’s student inattention. In many instances, faculty contribute to the problem. A student who is in a course because it is required, or because it is on a bar examination, is more likely to let his or her mind wander or to play games unless some more compelling reason exists to pay attention. Selecting several students to be responsible for discussion on a particular day invites other students to tune out. I’m not saying that all student inattention can be attributed to ineffective teaching, but enough of it is so attributable that faculty who encounter substantial numbers of inattentive students ought ask themselves what they can do to change the classroom atmosphere. If it’s just one or two students, then it’s probably not the professor, but then it’s simply a matter of pulling those students aside privately and laying down the law.

One goal of legal education is to teach future lawyers that professionals need to be responsible. Teaching law students to be responsible requires more than denying them the opportunity to be irresponsible. It requires guiding them around the tempting distractions. If law faculty become too controlling, how are the students going to fend for themselves after graduation when the faculty isn’t there to control things for them?

In recent years, one of the law teaching techniques that has been getting a good bit of attention and even some implementation is the so-called flipping of the classroom. Flipping the classroom isn’t something unique to law teaching, and in fact has its origins elsewhere in education but has been brought into legal education.

Flipping the classroom consists of recording lectures to which students can listen before class, so that the time in class can be devoted to discussion. The notion of recorded lectures meshes well with online legal education. But the concept poses some challenges.

First, in some respects students should be able to glean from reading assignments before class what is being spoken to them in a recorded lecture. I wonder if the cultural shift away from reading and in the direction of audio and video communication contributes to the need to hear, rather than read, the words that express whatever it is needs to be communicated as part of the learning process. Reading is, and will continue to be, an essential element of legal analysis, and enabling the drift away from reading is counterproductive. Imagine hearing, rather than reading, an Internal Revenue Code provision.

Second, opening time for discussion in the classroom is beneficial if the students are willing to engage in discussion. As noted in an earlier post in this series, students increasingly are reluctant to speak out, at least in some courses. Anecdotal evidence suggests that at least part of the reluctance is due to how other students react, often in ways that are not conducive to the development of analytical reasoning. Countering this reluctance by compelling students to speak can be inefficient because it wastes time, ineffective because it generates unhelpful responses, and problematic because it can heighten student anxiety.

Third, to the extent students fail to listen to the recorded lectures before the class, what can be accomplished in class is not an improvement over what can be accomplished when students fail to do the assigned reading. Something else is needed to engage students outside of the classroom before class, and I will discuss that later in this series.

There probably are some courses in which recorded lectures available before class can enhance the experience in the classroom. I can imagine that in courses such as Trial Practice, Pre-Trial Civil Practice, clinics, and other endeavors in which the classroom experience involves a much larger “doing” component, getting the preliminaries out of the way before class could be helpful.

Though I have my misgivings about the value of flipping the classroom, and whether it really is that much of an innovation, if any, when I have thought about doing it in my courses, I have realized the futility of limiting myself to audio. My classes involve significant visual elements. So I would need to video record these segments, and that requires a much higher level of support from various administrative offices. It would require some way of coordinating words with the graphics or other visual aids that are necessary to make the words meaningful.

Finally, recording lectures to be heard before class, whether in audio or video format, is a major step in the direction of taking the course online. Will it strengthen the temptation for students to skip class, thinking that they’ve learned from the lecture what they need for the examination and that what their classmates have to say is of much less value? Will it bring pressure from students to put the in-class portion online through some sort of synchronous technology? If so, does the bandwidth exist to support interaction among 90 students in a class? The implications of taking a course partway online need to be carefully examined. Each step needs to be deliberate, and not an uncontrolled slide into a fully online course.