Example topic page

Summary

A short description of the typical presentation of the topic in the textbooks and relation to empirical findings, the average score, good practices and bad practices.

Scores

Each of the ten textbooks is scored by leading experts from 1 (very poor) to 5 (very good) on the following question: Is the presentation of the topic in the textbook in line with empirical findings?

  1. Very poor (i.e. The presentation is fully in contradiction with empirical findings)

  2. Poor (i.e. The presentation is mostly in contradiction with empirical findings)

  3. Neither good nor poor (i.e. The presentation is partially in line and partially in contradiction with empirical findings)

  4. Good (i.e. The presentation is mostly in line with empirical findings)

  5. Very good (i.e. The presentation is fully in line with empirical findings)

When a textbook does not discuss the topic, we note “n.d.”.

To give an idea of how the results will be presented when the study has been conducted, we show some illustrative tables with random scores.

What we do not measure

This research does not measure everything. Two large areas left out are how much the textbook goes into empirical evidence, and its didactic qualities.

  • How much empirical evidence is discussed

This would often amount to measuring how extensive and detailed a textbook is as longer textbooks are more likely to devote more text to discussing empirical evidence. Rather than favouring long textbooks, we therefore decide to judge the textbooks solely based on whether the presentation of the topic is in agreement or contradicts empirical findings, not whether it discusses those empirical findings. Of course, it is highly relevant to observe whether textbooks do discuss the empirical findings themselves. We encourage experts to include this in the texts about the good and bad practices. But we do not include it in the scoring.

  • Didactic quality of the explanations of the topic

This is highly relevant for which textbook is most effective at teaching students economics. We have, however, decided to limit the scope of this study to the content itself, rather than the didactic quality of its presentation. An assessment of didactic quality requires different expertise and measurement methods. The didactic aspect of economics education receives substantially more attention in research than its content does. To maximise our added benefit we therefore focus on the less often studied aspect of the content.

Textbooks good practices

Overview of which textbooks treat this topic well with regard to empirical findings, and how they do it. This includes quotes and examples, and can relate to the tone, representation through text / visual models / equations / data, or implicit narratives. Note: this is a qualitative evaluation.

Textbooks bad practices

Overview of which textbooks treat this topic poorly with regard to empirical findings, and how they do it. This includes quotes and examples, and can relate to the tone, representation through text / visual models / equations / data, or implicit narratives. Note: this is a qualitative evaluation.

Other findings

This could be any of the following:

  • Unique elements found in one or more textbooks

  • Didactic or explanatory best practices found in the textbooks