Wednesday, December 26, 2012

TWO STUDENTS I MISJUDGED


I am now halfway through my 42nd year as a college teacher.   This semester (like all semesters) had its ups and downs.   There were days when every student seemed brilliant and days when no one seemed to be able to count to four.     I don’t think I taught any geniuses but almost every student appeared capable and, hopefully, gained something of lasting benefit.   I started with 73 students and a total of 16 finished with the grade of A.   I always hope for more excellent work but 21.9 percent was not bad.   I try not to contribute too heavily to grade inflation.

At the end of every semester, there are always a few students that I wish I had handled differently.   I often ponder them long after class has ended.   With 73 students, it can be difficult to get an accurate read on each student at the beginning of the semester.   Some need carrots to do well and some need sticks.   Often, I feel frustrated because I do not have the time needed to determine what buttons to push to get individual students excited about the learning process.    In those cases, I am left wondering if I helped or hindered the student’s learning.

When I travel around the county speaking to teachers, I get to talk with a lot of folks.  One common theme I hear is that students do not always appreciate what teachers do for them.   “If I work them hard, they are unhappy.”   “If I challenge them to go deeper, they rebel.”   “Why should I work so hard when the students prefer the easy way?”   Teaching can be really frustrating.

And, in truth, human beings (even teachers) need motivation.   Everyone needs a pat on the back as often as possible.   It is hard to beat your head against a wall if no one really appreciates what you do.

Occasionally, though, I am brought back to reality and reminded that many (if not most) students really do care about their education.   But, they do not always have an easy way to show their appreciation for what you do.   Last week, I got emails from two of my fall students, two students that I never expected to hear from because I was not sure whether I had taught them anything or not.   Until I got their emails, I would have included them on the list of:   “I didn’t get through to these students very well.”   I guess that is my point:   Sometimes you just never know.

Student A

Student A seemed extremely quiet.   He was a student in my Introduction to Financial Accounting class.   When I called on him each day, he would take a long time to answer and his answers frequently seemed very hesitant and unsure.   As a result, if you had asked me, I would have said that he was not well prepared.  I assumed his hesitancy was because he was not terribly interested in the material.   From my vantage point, that was how it appeared.

The email I got from Student A last week was 1,276 words long.   I cannot remember ever getting such a long email from a student.   All semester, I thought he was a relatively nonverbal student when, in fact, he was just quiet.   He was not uninterested, he was quiet.   If this email was any indication, he was actually a very very verbal student.  

This student that I thought was basically uninterested in financial accounting was, in fact, one of the most interested.   I would have said that he did not appreciate what I did when he really did.   I misjudged him completely.   I am not sure how I should have taken advantage of that knowledge but I judged him incorrectly and probably should have pushed him harder.

Here are just a few (494) of those 1,276 words.

“I wanted to wait to message you until after I received my final numbers so I didn't appear as a brown noser pleading for a better grade. I just wanted to thank you for a great semester. Regardless of whether my letter grade ended as an A, B or C, I can honestly and confidently say that I walked away from your course knowing a great deal of new information about accounting. This class was unique for me- instead of studying just enough so I could pass a test and then forget everything I had learned, the accounting information became ingrained in my head. I began to, actually, like my accounting course. What impresses me most about your teaching abilities is that you instruct a course (accounting) that is considered to be boring/monotonous/dreary by so many people, and you manage to spark an interest within your students. . . . You ran a very tight ship, but that is what you told us to expect from the beginning. From day one, and through each and every email and paper you sent to us, you reinforced the fact that you would expect a lot of time and dedication from us. I appreciate your honesty. I appreciate your strategy of pushing your students to their academic limits. . . .  The thing that had the biggest impact on my thinking was the comparison you made one day between professional athletes and business world professionals. You said that when we look at professional athletes, we automatically assume that they had put in countless hours of perfecting their craft to be where they're at now but, for some reason, the same generalization is not made about those who work in the higher levels of business. This statement was very true and I thought about it for a long time after class. I questioned my own efforts and settled on the fact that I had not previously been putting in the time to my studies that I should have been. I do not lack any work ethic in the athletic department, probably because it is what I love to do the most. A few hundred swings and hours in the weight room are no hassle to me. However, I could honestly say that during my freshman year, and during most of this past semester, I was doing enough to get by and do 'well enough' but was I really pushing myself to become substantially better in the classroom? The answer was no- not at all. Your words that day helped me redefine my work ethic when it came to school. I started taking a little more pride and setting aside a little more time for my studies. I kept my new approach through the end of this past semester and I was pleased with my final grades. I am not saying you are the sole reason why I did well overall this semester, but your lessons definitely helped me.”

 
Student B

Student B was in my Intermediate Accounting II class and seemed completely uninterested.   His answers were almost flippant and I kept wanting to ask him why he was in the class if he cared so little.   His work on tests was all over the place from a 71 to a 92.   I fully expected him to make a D or an F on the final exam and perhaps a D in the course.   In my own mind, I had him firmly labeled as “having not one iota of interest in accounting.”

But then, Student B made a strong A on the final exam, a test that I considered incredibly complicated.   I was stunned.   I wondered if he had sent in a clone to take the test for himself.   I would have bet that he did not appreciate one thing about my teaching of that class so I didn’t understand that excellent work on the final exam.

Then, out of the blue, I got the following email.

“I just want to thank you for a fantastic semester. I can honestly say I enjoyed coming to your class every day of the week, as it was one of the only classes where I felt that I could sit and figure things out instead of scrambling to write down every word the professor says, to try and "learn" it later. After this semester I feel that I have grown much as a person, and more than ever find pleasure in things intellectual and thought-provoking. In car rides that used to be filled by whatever mindlessly popular music the radio station chose to broadcast, I now find myself either listening to talk radio or turning off the radio all together and pondering different facets of my life or humanity as a whole.   Not only has this class enriched my ability to think about life, but I feel to have gained a real understanding of financial accounting. While during the semester I may have seemed somewhat uninterested, I promise you this was never the case. My problem was that I easily understood about 85% of the material, and thus didn't feel particularly pressed to immediately work for the other 15%. Interestingly enough, when I sat down to begin studying for the final, I found that going back through the material was not as stressful as I expected it to be. The concepts I had learned throughout the entire semester were clear and seemed to flow together perfectly. I honestly enjoyed the 4 hour final, as it gave me a chance to sit down and think through problems, and the fact that I was able to easily reason through them was actually fairly exciting for me.”

I had 73 students this semester.    Only 3 or 4 chose to write me an email about the semester.   And, much to my surprise, two of the most interesting emails came from students that

(a) I clearly did not understand too well during the semester and

(b) I would have labeled as not at all appreciative of the class.

As I have said before, I write these blog entries for me more than for you.   So, what should I take away from these two emails?

First – don’t rely too much on external appearances.   Work harder to get to know the students as best you can.   One of the absolute great things about teaching is that every student brings his or her own issues and personality to your class.   After all, you don’t teach a class; you teach people.  

Second – don’t waste so much time worrying about whether students appreciate what you do.   You simply may never know.   If you work hard and if you understand what you want your students to learn and if you challenge them (but do so fairly), they will come to appreciate what you do.   Yeah, there may never be a way for them to express that appreciation but it is there.
 

Friday, December 14, 2012

EVERYONE CHANGES OVER TIME

Happy holidays to all the teachers out there.   This blog just went over 67,800 page views.   I have been thrilled throughout the year to have the chance to interact with so many wonderful educators.  

**

When I give teaching presentations around the country, I am often asked how my teaching has changed during the past 42 years.   Because I stress working for 5 percent improvement each year, that particular question is certainly a legitimate one.   Invariably someone will jump up and ask:   Okay, how are you managing to improve over time?

I actually have a couple of different answers for that question.   But, there is one response that I always give:   During the past decade, I have come to spend a lot more time writing my test questions.   I used to throw tests together hurridly with one goal:   to be fair.   Now, though, I view testing as a much more important element of my class environment, one that requires a significant amount of preparation time. 

I occasionally argue in this blog that the way you test students is the way they will learn.   No matter what you tell them, if you test memorization, they will memorize.   If your tests are purely mechanical, they will only learn the mechanics.   If you only test at a superficial level, they will only learn material to that same shallow depth.   I believe this is the absolute truth.   The type of tests you create has a huge influence on the type of learning that the students do.

I am always shocked by how many well intentioned faculty members turn testing over to a textbook test bank.   I want to run screaming into the night when I hear that.   In my opinion, an overworked graduate student who does not know you or your students is not in any position to write a legitimate test for your students.   When writing this blog, I sometimes discuss what I would do if I were king of education.   Burning all test banks would be one of my first royal acts.

Yes, I know you are extremely busy.   But abdicating this valuable task to a person who might never have taught a single class (or a class like yours) makes no sense.   Any test in your class should be designed for your students based on what you have covered and based on what you want them to know.   It should not be composed of randomly selected questions written by some mysterious stranger.   To me, using a test bank is like asking Mickey Mouse to pinch hit for Babe Ruth.    You are giving away an essential element of the course to someone who might not be up to the task.

Over the decades, I have worked very hard to learn how to write good questions.   During those years, I have written some questions that were horrible.   But, I have learned much from that experience.  

--The first thing I learned about test writing was that a question that everyone could answer was useless.  
--The second thing that I learned was that a question that no one could answer was also useless.  

As with any task, you practice and you look at the results and you get better.   You don’t hand off an essential part of your course to a test bank.

As everyone who has read this blog for long probably knows, one of the things I started doing about 8 years ago was allowing students to bring handwritten notes to every test.   That immediately stopped me from writing questions that required memorization because the students had all that material written down and in front of them.

That was a good start but that was not enough.   Allowing notes pushed me in the right direction but it did not get me to the tests I wanted.   It takes practice and study.  

About 3 weeks ago, I wrote a 75 minute test for my introduction to Financial Accounting class here at the University of Richmond.  This test was the last one of the semester (prior to the final exam).  By that time, I surely believed that everyone in the class had come to understand what I wanted them to accomplish.   So, I wanted to test the material in such a way as to see how deeply they really did understand it.  

I wrote 12 multiple-choice questions designed to take about 4-8 minutes each.   For accounting tests that are often numerically based, I like multiple-choice questions because I can give 6-8 potential answers and, therefore, limit the possibility of a lucky guess.  

In writing the first four of these questions, I tried to envision what an A student could figure out but that a B student could not.   In other words, I wanted these four questions to show me the point between Good and Excellent.   These were tough.   For those questions, I really didn’t worry about the C, D, or F students.   These questions were designed specifically to see if I could divide the A students from the B students.

The next four questions were created to divide the B students from the C students.   They were easier questions but a student would have to have a Good level of understanding to figure them out.  I knew the A students could work these questions and I knew the D students could not work them.   These four were written to split the B students from the C students.

The final four questions were created to divide the C students from those with a lesser level of understanding.   They were easier but still not easy.  I wanted to see who deserved a C and who did not.   If a student could get those four questions correct, that (to me) was average work.   Those students deserved at least a C.   But, if a student could not get those four, they really had failed to achieve a basic level of understanding worthy of a C.  

Then, I shuffled the 12 questions and gave them to my students.

How did this test work out in practice?   Pretty well.   When it was over, I put the papers in order from best to worse to see if I was comfortable with the results.   I genuinely felt like I could tell the A students from the B students from the C students from everyone else.   And, isn’t that a primary reason for giving a test?

Okay, I had to create a pretty interesting curve to get the grades to line up with what I thought I was seeing.   But I am the teacher for this class.  That evaluation should be mine.  I tell my students early in the semester that I do not grade on raw percentages.   Getting 66 percent of the questions correct should not automatically be a D.   In fact, in many cases, getting 66 percent of the questions correct might well be a very impressive performance.   It depends on the difficulty of the questions.

After the first test, students will often ask something like, “I only got four questions out of 12 correct and I still got a C, how can that be?”   My answer is simple “by answering those four questions, you have shown me how much you have understood and I thought that level of understanding deserved a C.”

If I take an adequate amount of time and write good questions, I believe I can gain a good evaluation of the knowledge of the student.   And I usually find they will work harder after that to achieve a deeper level of understanding because they begin to see what I am after.   The way you test is the way your students will learn.