An evaluation of the risk education module Exploring Environmental Issues: Focus on Risk

Covitt, Beth A., Gomez-Schmidt, Christina, & Zint, Michaela T. (2005). An Evaluation of the Risk Education Module. The Journal of Environmental Education, 36(2), 3-13,. 10.3200/JOEE.36.2.3-13

Many environmental issues come down to judging risk: how likely harm is, how bad it would be, and what to do about it. Should a town allow a hazardous waste facility nearby? Do the benefits of chlorine outweigh its harms? Young people often find the ideas behind these questions hard, and few classroom materials teach them directly. Project Learning Tree, an environmental education program, created Focus on Risk to help students in grades 9 to 12 build the knowledge and skills to join public discussions and decisions about environmental and human health risks. The researchers wanted to know whether the module did this when teachers used it in ordinary classes.

Focus on Risk has 11 activities. Seven introduce key ideas:

  • what risk is and how people perceive it;
  • probability, meaning the chance that something will happen;
  • risk assessment, meaning how scientists estimate the chances and size of possible harm;
  • risk communication;
  • weighing costs against benefits;
  • making decisions about risk.

Three activities explore risks linked to electromagnetic fields, chlorine and plastics. The final activity is an action project in which students help manage a real environmental risk.

Sixteen teachers, almost all science teachers, used the module with 28 classes. Each teacher was asked to do at least three activities, choosing the ones that fit their curriculum, and teaching lasted anywhere from 1 to 22 weeks. In total, 532 of their students completed a test and survey before and after. For comparison, 305 students in 20 classes that did not use the module took the same test and survey. These classes were taught by 11 teachers, most of whom also taught module classes or worked at the same schools. Students were in grades 7 to 12, and most lived in rural areas.

The test had 25 multiple-choice questions set in unfamiliar real-life situations. For example, one described a town considering a hazardous waste facility and asked which method scientists use to estimate the chance that its safety system fails. The survey asked students:

  • how well they thought they understood risk;
  • their opinions about how risks should be managed;
  • how responsible they felt for managing risks in their own lives and to the environment;
  • how much control they felt they had over environmental risks, alone and working with others.

Module students also wrote comments about the activities, and their teachers kept logs rating the module.

What the researchers found:

  1. The main finding is that students' knowledge grew, but their sense of responsibility and control did not. Module students answered about 10.5 of the 25 test questions correctly on average, compared with about 8 for the other students. But the two groups did not differ in how responsible they felt for managing risks, or in how much control they felt they had over risks to the environment. The researchers conclude that the module is unlikely to build these feelings, even when students complete every activity.
  2. The more activities a class did, the more students learned. Each extra activity was linked to a higher test score. Only three classes completed all 11 activities, and they were the only ones that did the action project. Their 42 students averaged about 14 correct answers, the highest of any group. Most classes did between two and seven activities. The researchers conclude that using the module as a "pick and choose" collection is not very effective.
  3. Students thought they knew more than they did. Module students rated their own risk knowledge much higher than the comparison students did, yet the gap between the groups on the actual test was small. The researchers read this as module students overestimating what they had learned.
  4. Students in both groups felt much more able to manage environmental risks with others than alone. The researchers note that facing environmental problems alone can feel overwhelming to young people.
  5. Some opinions about risk shifted. Module students were more likely than the other students to agree that:
    • ordinary people's values should count when government manages risks;
    • TV and the internet shape how people see risks;
    • scientific risk assessments should help government decide which issues to tackle first.
  6. One misconception did not change. Many students in both groups agreed that "if there's uncertainty about a risk, nothing should be done about it." The researchers point out that if students had learned that almost every risk involves some uncertainty, they would have agreed less.
  7. Students' reactions were mixed. Many enjoyed learning about everyday risks and found the topic relevant. One wrote that once they realized the risks involved them, they got interested. Others found the activities too hard (some seventh graders struggled with the terms) or too easy, and a few found them boring. Several said learning about so many risks made them feel scared or depressed. Students asked for:
    • videos, hands-on tasks, class discussions and group work;
    • risks closer to teenagers' lives, such as smoking and drinking;
    • more ways to reduce risks themselves;
    • for some who had not done one, a project tackling a risk in their own community.
  8. Teachers rated the module highly. They found it relevant to students' lives, good at sparking interest and useful for building skills to reduce personal risks. They saw it as a better fit for science than for social studies or math, and felt administrators and parents approved of it. The researchers note the contrast between teachers' positive views and the more modest results for students.

What this means for your practice:

  • Teach risk as a connected sequence, not a few one-offs. Students learned more with every extra activity, and classes that did the whole module scored highest. The researchers recommend that students do most, if not all, of the activities. If your time is limited, plan a linked run of lessons rather than single sessions.
  • Give students a way to make risk decisions, and let them practice it. Knowledge grew but students' sense of control did not, so the researchers recommend adding a clear framework for making risk decisions. They suggest practicing it through action projects on a real environmental risk or through simulations of managing a risk. In this study, only three classes did an action project. That was too few to show whether it helped, though their results pointed in a positive direction.
  • Plan for fear. Low scores for control and students' comments both showed that learning about hazards can leave young people feeling scared and helpless. The researchers urge educators to pair understanding of dangers with ways young people can manage risks in their own lives and environment. Students themselves asked for more ways to prevent or avoid risks.
  • Start with risks students already know. Some ideas were hard to grasp, and some environmental examples felt distant to students. The researchers suggest introducing abstract ideas such as probability through familiar risks like smoking, drinking or drug use, then moving to environmental ones.
  • Use group work. Students felt far more able to tackle environmental risks with others than alone. Group projects and shared problem-solving build on that.
  • Talk about uncertainty openly. Many students believed that nothing should be done about an uncertain risk, and the module did not shift this. Explaining that almost every risk involves some uncertainty, and that decisions still have to be made, addresses this directly.
  • Plan with colleagues in other subjects. The module was designed for use across subjects, but almost only science teachers used it. The researchers recommend that teachers from different subjects work together, so students meet more risk activities and action projects and see the links between subjects.

RETURN TO RISK AND ENVIRONMENTAL EDUCATION EERESEARCH COLLECTION 

The Bottom Line

Many environmental issues come down to judging risk: how likely harm is, how bad it would be, and what to do about it. Should a town allow a hazardous waste facility nearby? Do the benefits of chlorine outweigh its harms? Young people often find the ideas behind these questions hard, and few classroom materials teach them directly. Project Learning Tree, an environmental education program, created Focus on Risk to help students in grades 9 to 12 build the knowledge and skills to join public discussions and decisions about environmental and human health risks. The researchers wanted to know whether the module did this when teachers used it in ordinary classes.