What I've learned about teaching advanced undergraduate seminars

At Yale, economics majors are required to take two “senior seminars” before they graduate. These classes usually have 10-20 students and revolve around reading and discussing contemporary research in a specific area. After three years of mostly big lecture classes on theory and methods, seniors finally get a chance to apply what they’ve learned to a substantive topic.1 I just finished my fourth year of teaching two of these seminars, and while that might not seem like very long, I have learned a lot about what works and what doesn’t work.

Big Goals

Every seminar should have both a substantive theme and a methodological theme. In the fall I teach the Economics of Aging. We read papers on retirement, saving, elder care, and inheritance–if it’s economics and it affects older people, the topic is fair game. Most of the papers we read use structural microeconometric methods. The theory and estimation methods are serious–I still remember the shocked look a senior faculty member gave me when I told him we were reading Rust and Phelan’s 1997 paper on Social Security, Medicare, and Retirement2. In the spring, I teach the Economics of Human Capital in Latin America. The papers are mostly about the determinants of health and schooling in the region and most use reduced form program evaluation techniques. I teach just enough about difference-in-differences, matching, regression discontinuity, and instrumental variables so that my students can understand why an author chose a particular method and can interpret the results. By the end of the semester, my students can read a big chunk of the research literature that was previously inaccessible.

Reading

I require my students to read two or three dense articles each week. I tell them they are hard and not to expect to understand everything immediately–these aren’t fluffy beach novels. I encourage them to work at it and tell them I wouldn’t have assigned the articles if I didn’t think they were smart enough to figure them out. To help them focus, students must fill out and submit a worksheet for each paper before we discuss it in class. Some articles (like surveys or policy reports) get special worksheets, but most worksheets contain these seven questions:

  1. What is the research question? There may be more than one, but usually one is most important.
  2. What is the answer to the research question?
  3. Why is this paper important
  4. If there is an economic model, what is the behavior or process being modeled? What are the key characteristics of the model?
  5. What is the empirical approach?
  6. What data does the paper use?
  7. What didn’t you understand?

The worksheets keep students thinking critically and constructively. The last question is most important to me as it tells me what I need to cover well during class time. The syllabus also suggests optional papers for most weeks in case students are particularly interested in a topic.

Student Presentations

Each week two or three students help me teach the class. They read the papers ahead of time and we meet to make sure they understand them well. These meetings are a pretty efficient way for me to review the week’s material and get to know my students. We usually plan short presentations on the papers that cover the basics quickly and some of the important technical parts that the rest of the class might have missed when they read the papers. Often the presentations contain new stuff from related or more recent papers to spur discussion. An easy way to put a class to sleep is to tell them things they already know.3 The students then draft slides which I review the night before class. Again, it’s a great way for me to prepare and it means there is never a bad presentation.

During class, I interrupt the speakers often to offer alternative explanations of difficult points and ask the rest of the students questions. I try to do it in a constructive/respectful way–the goal is for everyone to be engaged and at least following along.

Discussion

After the presentations, I usually divide the class into small groups of 4-5 students each and give each group a job. Sometimes they will design a conditional cash transfer program for a particular context. Sometimes they will prepare for a debate on alternatives to social security. Sometimes they will make a list of the three most important questions in an area that remain unanswered. The key is that the students never know exactly what’s going to happen when they walk into the classroom. After the groups work for 15-20 minutes, we all talk about what they’ve come up with as a big group.

Sometimes we don’t have time for any discussion because I’ve given a mini lecture about an econometric method that they need to know in order to do the reading for the next week. I’ll have a few questions for the class prepared, but mostly we proceed organically with an eye on the clock.

Papers/Projects

Most seminars require some sort of paper, but it’s often not well-defined and the instructor sees it for the first time when it’s passed in at the end of the semester. That is very different from how it works in my seminars. Each student works throughout the semester on a research proposal and gets lots of feedback from their peers and me during the process.

At about week 3, they pass in a one page summary of their research idea. Before this, I try and give an overview of the topics we’ll cover during the semester. I also describe three or four successful proposals from earlier semesters. Their one-pagers are ungraded but I do tell them if I think they’re on the right track, give them ideas on how to refine their ideas, and point them to relevant literature.

They draft the front-end of the proposal in the middle of the semester. This builds on the research question and contains a literature review, a hypothesis, and an economic model. They’ve seen several models in papers and other classes by this point, but constructing one of your own to explain how a process works is a difficult but rewarding experience. I don’t expect them to formally prove any theorems based on their models–they can do that if they go to grad school.

Before they pass in their mid-term proposal, I spend a little class time explaining what I expect in the literature review and walk through the process of constructing an example model. I also hold three or four “work groups” outside class where 5-6 students and I talk through each student’s project. It’s more time-efficient than having one-on-one meetings and incredibly useful for the students to hear about and contribute to each other’s work.

I spend a fair bit of time giving constructive feedback on the midterm proposal. I give comparatively much less feedback on the final papers as most students don’t read those comments and even fewer will act on those comments. I expect every student to incorporate my mid-term feedback into their final paper.

We have another round of work group meetings near the end of the semester to talk about the last pieces of the final proposal: the empirical approach and the data. Here’s where they have to decide how to actually answer the question they posed at the beginning of the semester. The whole process exercises the creative part of their brain that is vastly under-used in most classes.

The important thing is not that the paper is a research proposal, though that works well for me. The key is that students actually work on it throughout the semester and get feedback along the way.

Miscellaneous Advice

I believe one of the most valuable services I provide is just being available. Elite college professors are not typically great teachers. They are selected for their research skills and knowledge of the field. They should use this comparative advantage in their teaching by answering questions and talking about the state-of-the-art. These classes are small–I am never overwhelmed answering questions after class or during office hours. We aren’t talking about 300 person lectures where you could spend your life answering student email. The bottom line is that most students really appreciate human contact.

I try to have a very open mind about improving the class and talk to other instructors about what works and doesn’t work for them. I also take the last 15-20 minutes of the last class every semester getting direct feedback about what worked and what didn’t. Formal student evaluations are valuable, but they don’t allow for a conversation. I can throw out ideas and see what they think. I can ask follow-up questions. Some students’ ideas spawn other students’ ideas. And every year, I learn new things that improve my class.

I refresh my classes at least a little bit every time I teach. I’ll dump the worst week. I’ll add papers I’ve come across over the last year that are interesting and relevant. I’ll try new exercises in class. And I’ll change what I expect from student presentations. It’s a lot easier to keep students excited when I’m excited.

Update: Donald Kagan has a very different but intriguing method for teaching seminars.

Footnotes:

  1. Juniors can take these classes if they meet the pre-requisites (at least two of intermediate micro, intermediate macro, and econometrics), but seniors get priority and the most popular seminars are full by the time juniors can register. It’s a shame, really, since these seminars can be great training for writing a senior essay. 

  2. His exact words were “You can’t teach that paper to undergraduates!” He was wrong–the motivation and descriptive sections of the paper are very well-written and approachable. The model of retirement presented is tough, but straight-forward. And the results are easy to understand once you understand the model. We skip the heavy duty derivation of estimation method. 

  3. It’s also a great way to encourage them to skip the reading.