A new study shows visiting an art museum improves critical thinking skills and more. An excerpt from “The Educational Value of Field Trips,” originally published in Education Next, Winter 2014.
This article originally appeared in the January/February 2014 issue of Museum magazine.
The school field trip has a long history in American public education. For decades, students have piled into yellow buses to visit a variety of cultural institutions, including art, natural history and science museums, as well as theaters, zoos, and historical sites. Schools gladly endured the expense and disruption of providing field trips because they saw these experiences as central to their educational mission: schools exist not only to provide economically useful skills in numeracy and literacy but also to produce civilized young men and women who would appreciate the arts and culture. More advantaged families may take their children to these cultural institutions outside of school hours, but less-advantaged students are less likely to have these experiences if schools do not provide them. With field trips, public schools viewed themselves as the great equalizer in terms of access to our cultural heritage.
Today, culturally enriching field trips are in decline. Museums across the country report a steep drop in school tours. For example, the Field Museum in Chicago at one time welcomed more than 300,000 students every year. Recently the number is below 200,000. Between 2002 and 2007, Cincinnati arts organizations saw a 30 percent decrease in student attendance. A survey by the American Association of School Administrators found that more than half of schools eliminated planned field trips in 2010-11.
The decision to reduce culturally enriching field trips reflects a variety of factors. Financial pressures force schools to make difficult decisions about how to allocate scarce resources, and field trips are increasingly seen as an unnecessary frill. Greater focus on raising student performance on math and reading standardized tests may also lead schools to cut field trips. Some schools believe that student time would be better spent in the classroom preparing for the exams. When schools do organize field trips, they are increasingly choosing to take students on trips to reward them for working hard to improve their test scores rather than to provide cultural enrichment. Schools take students to amusement parks, sporting events and movie theaters instead of to museums and historical sites.
If schools are de-emphasizing culturally enriching field trips, has anything been lost as a result? Surprisingly, we have relatively little rigorous evidence about how field trips affect students. The research presented here is the first large-scale randomized control trial designed to measure what students learn from school tours of an art museum.
We find that students learn quite a lot. In particular, enriching field trips contribute to the development of students into civilized young men and women who possess more knowledge about art, have stronger critical-thinking skills, exhibit increased historical empathy, display higher levels of tolerance, and have a greater taste for consuming art and culture.
Design of the Study and School Tours
The 2011 opening of the Crystal Bridges Museum of American Art in Northwest Arkansas created the opportunity for this study. Crystal Bridges is the first major art museum to be built in the United States in the last four decades, with more than 50,000 square feet of gallery space and an endowment in excess of $800 million. Portions of the museum’s endowment are devoted to covering all of the expenses associated with school tours. Crystal Bridges reimburses schools for the cost of buses, provides free admission and lunch, and even pays for the cost of substitute teachers to cover for teachers who accompany students on the tour.
Because the tour is completely free to schools, and because Crystal Bridges was built in an area that never previously had an art museum, there was high demand for school tours. Not all school groups could be accommodated right away. So our research team worked with the staff at Crystal Bridges to assign spots for school tours by lottery. During the first two semesters of the school tour program, the museum received 525 applications from school groups representing 38,347 students in kindergarten through grade 12. We created matched pairs among the applicant groups based on similarity in grade level and other demographic factors. An ideal and common matched pair would be adjacent grades in the same school. We then randomly ordered the matched pairs to determine scheduling prioritization. Within each pair, we randomly assigned which applicant would be in the treatment group and receive a tour that semester and which would be in the control group and have its tour deferred.
We administered surveys to 10,912 students and 489 teachers at 123 different schools for three weeks, on average, after the treatment group received its tour. The student surveys included multiple items assessing knowledge about art as well as measures of historical empathy, tolerance and sustained interest in visiting art museums.
We also assessed students’ critical thinking skills by asking them to write a short essay in response to a painting that they had not previously seen. Finally, we collected a behavioral measure of interest in art consumption by providing all students with a coded coupon good for free family admission to a special exhibit at the museum to see whether the field trip increased the likelihood of students making future visits.
The intervention we studied is a modest one. Students received a one-hour tour of the museum in which they typically viewed and discussed five paintings. Some students were free to roam the museum following their formal tour, but the entire experience usually involved less than half a day. The discussion of each painting during the tour was largely student-directed, with the museum educators facilitating the discourse and providing commentary beyond the names of the work and the artist and a brief description only when students requested it.
Results
Recalling Tour Details. Our research suggests that students retain a great deal of factual information from their tours. Students who received a tour of the museum were able to recall details about the paintings they had seen at very high rates. For example, 88 percent of the students who saw the Eastman Johnson painting “At the Camp-Spinning Yams and Whittling” knew when surveyed weeks later that the painting depicts abolitionists making maple syrup to undermine the sugar industry, which relied on slave labor. Similarly, 82 percent of those who saw Norman Rockwell’s “Rosie the Riveter” could recall that the painting emphasizes the importance of women entering the workforce during World War II. Among students who saw Thomas Hart Benton’s “Ploughing It Under,” 79 percent recollected that it is a depiction of a farmer destroying his crops as part of a Depression-era price support program. And 70 percent of the students who saw Romare Bearden’s “Sacrifice” could remember that it is part of the Harlem Renaissance art movement. Since there was no guarantee that these facts would be raised in student-directed discussions, and because students had no particular reason for remembering these details (there was no test or grade associated with the tours), it is impressive that they could recall historical and sociological information at such high rates.
These results suggest that art could be an important tool for effectively conveying traditional academic content, but this analysis cannot prove it. The control-group performance was hardly better than chance in identifying factual information about these paintings, but they never had the opportunity to learn the material. The high rate of recall of factual information by students who toured the museum demonstrates that the tours made an impression. The students could remember important details about what they saw and discussed.
Critical Thinking. Beyond recalling the details of their tour, did a visit to an art museum have a significant effect on students? Our study demonstrates that it did. For example, students randomly assigned to receive a school tour of Crystal Bridges later displayed demonstrably stronger ability to think critically about art than the control group.
During the first semester of the study, we showed all 3rd- through 12th-grade students a painting they had not previously seen, Bo Bartlett’s “The Box.” We then asked students to write short essays in response to two questions: What do you think is going on in this painting? And, what do you see that makes you think that? These are standard prompts used by museum educators to spark discussion during school tours. We stripped the essays of all identifying information and had two coders rate the compositions using a seven-item rubric for measuring critical thinking that was developed by researchers at the Isabella Stewart Gardner Museum in Boston.
We express the impact of a school tour of Crystal Bridges on critical thinking skills in terms of standard deviation effect sizes. Overall, we find that students assigned by lottery to a tour of the museum improve their ability to think critically about art by 9 percent of a standard deviation relative to the control group. The benefit for disadvantaged groups is considerably larger.
A large amount of the gain in critical thinking skills stems from an increase in the number of observations that students made in their essays. Students who went on a tour became more observant, noticing and describing more details in an image. Being observant and paying attention to detail is an important and highly useful skill that students learn when they study and discuss works of art.
Historical Empathy. Tours of art museums also affect students’ values. Visiting an art museum exposes students to a diversity of ideas, peoples, places and time periods. That broadening experience imparts greater appreciation and understanding. We see the effects in significantly higher historical empathy and tolerance measures among students randomly assigned to a school tour of Crystal Bridges.
Historical empathy is the ability to understand and appreciate what life was like for people who lived in a different time and place. This is a central purpose of teaching history, as it provides students with a clearer perspective about their own time and place. To measure historical empathy, we included three statements on the survey with which students could express their level of agreement or disagreement: 1) I have a good understanding of how early Americans thought and felt; 2) I can imagine what life was like for people 100 years ago; and 3) When looking at a painting that shows people, I try to imagine what those people a thinking. We combined these items into a scale measuring historical empathy.
Students who went on a tour of Crystal Bridges experience a 6 percent of a standard deviation increase in historical empathy. Among rural students, the benefit is much larger, a 15 percent of a standard deviation gain. The fact that Crystal Bridges features art from different periods in American history may have helped produce these gains in historical empathy.
Tolerance. To measure tolerance, we included four statements on the survey with which students could express their level of agreement or disagreement: 1) People who disagree with my point of view bother me; 2) Artists whose work is critical of America should not be allowed to have their work shown in art museums; 3) I appreciate hearing views different from my own; and 4) I think people can have different opinions about the same thing. We combined these items into a scale measuring the general effect of the tour on tolerance.
Overall, receiving a school tour of an art museum increases student tolerance by 7 percent of a standard deviation. As with critical thinking, the benefits are much larger for students in disadvantaged groups. Rural students who visited Crystal Bridges experience a 13 percent of a standard deviation improvement in tolerance. For students at high-poverty schools, the benefit is 9 percent of a standard deviation.
Interest in Art Museums. Perhaps the most important outcome of a school tour is whether it cultivates an interest among students in returning to cultural institutions in the future. If visiting a museum helps improve critical thinking, historical empathy, tolerance and other outcomes not measured in this study, then those benefits would compound for students if they were more likely to frequent similar cultural institutions throughout their life. The direct effects of a single visit are necessarily modest and may not persist, but if school tours help students become regular museum visitors, they may enjoy a lifetime of enhanced critical thinking, tolerance and historical empathy.
We measured how school tours of Crystal Bridges develop in students an interest in visiting art museums in two ways: with survey items and a behavioral measure. Interest in visiting art museums among students who toured the museum is 8 percent of a standard deviation higher than that in the randomized control group. Among rural students, the increase is much larger: 22 percent of a standard deviation. Students at high-poverty schools score 11 percent of a standard deviation higher on the cultural consumer scale if they were randomly assigned to tour the museum. And minority students gain 10 percent of a standard deviation in their desire to be art consumers.
We also measured whether students are more likely to visit Crystal Bridges in the future if they received a school tour. All students who participated in the study during the first semester, including those who did not receive a tour, were provided with a coupon that gave them and their families free entry to a special exhibit at Crystal Bridges. The coupons were coded so that we could determine the applicant group to which students belonged. Students had as long as six months after receipt of the coupon to use it.
We collected all redeemed coupons and were able to calculate how many adults and youths were admitted. Though students in the treatment group received 49 percent of all coupons that were distributed, 58 percent of the people admitted to the special exhibit with those coupons came from the treatment group. In other words, the families of students who received a tour were 18 percent more likely to return to the museum than we would expect if their rate of coupon use was the same as their share of distributed coupons.
This is particularly impressive given that the treatment-group students had recently visited the museum. Their desire to visit a museum might have been satiated, while the control group might have been curious to visit Crystal Bridges for the first time. Despite having recently been to the museum, students who received a school tour came back at higher rates. Receiving a school tour cultivates a taste for visiting art museums, and perhaps for sharing the experience with others.
Disadvantaged Students
One consistent pattern in our results is that the benefits of a school tour are generally much larger for students from less-advantaged backgrounds. Students from rural areas and high-poverty schools, as well as minority students, typically show gains that are two to three times larger than those of the total sample. Disadvantaged students assigned by lottery to receive a school tour of an art museum make exceptionally large gains in critical thinking, historical empathy, tolerance and becoming art consumers.
It appears that the less prior exposure to culturally enriching experiences students have, the larger the benefit of receiving a school tour of a museum. We have some direct measures to support this explanation. To isolate the effect of the first time visiting the museum, we truncated our sample to include only control-group students who had never visited Crystal Bridges and treatment-group students who had visited for the first time during their tour. The effect for this first visit is roughly twice as large as that for the overall sample, just as it is for disadvantaged students.
When we examine effects for subgroups of advantaged students, we typically find much smaller or null effects. Students from large towns and low-poverty schools experience few significant gains from their school tour of an art museum. If schools do not provide culturally enriching experiences for these students, their families are likely to have the inclination and ability to provide those experiences on their own. But the families of disadvantaged students are less likely to substitute their own efforts when schools do not offer culturally enriching experiences. Disadvantaged students need their schools to take them on enriching field trips if they are likely to have these experiences at all.
Policy Implications
School field trips to cultural institutions have notable benefits. Students randomly assigned to receive a school tour of an art museum experience improvements in their knowledge of and ability to think critically about art, display stronger historical empathy, develop higher tolerance, and are more likely to visit such cultural institutions as art museums in the future. If schools cut field trips or switch to “reward” trips that visit less-enriching destinations, then these important educational opportunities are lost. It is particularly important that schools serving disadvantaged students provide culturally enriching held trip experiences.
This first-ever, large-scale, random-assignment experiment of the effects of school tours of an art museum should help inform the thinking of school administrators, educators, policymakers and philanthropists. Policymakers should consider these results when deciding whether schools have sufficient resources and appropriate policy guidance to take their students on tours of cultural institutions. School administrators should give thought to these results when deciding whether to use their resources and time for these tours. And philanthropists should weigh these results when deciding whether to build and maintain these cultural institutions with quality educational programs. We don’t just want our children to acquire work skills from their education; we also want them to develop into civilized people Students tour the galleries at the Crystal Bridges Museum of American Art. who appreciate the breadth of human accomplishments. The school field trip is an important tool for meeting this goal.
Jay P. Greene is professor of education reform at the University of Arkansas, Fayetteville, where Brian Kisida is a senior research associate. Daniel H. Bowen is a postdoctoral fellow at Rice University’s Ki nder Institute, Houston, Texas. Anne Kraybill, school and community programs manager at Crystal Bridges Museum of American Art, oversaw the development and implementation of the school tours. To read the full report, go to http// educationnext.org/the-educational-value·of- field-trips/
Comments