The Impact of a Pilot Television Show “Lost in Loop” on Kids’ Knowledge of Science Concepts

January 1st, 2010 | EVALUATION

LOOP is a new animated television series from WGBH for children that is designed to improve the environmental and scientific literacy of children ages 5-8. WGBH developed a pilot episode of the program and tested it in the fall of 2010. WGBH hired independent evaluator Concord Evaluation Group, LLC (CEG) to conduct formative evaluation of the full pilot episode including the 25-minute animatic and the live-action video to assess the impact of LOOP on kids' knowledge of environmental science concepts. CEG performed an experimental study specifically a posttest-only control group design to explore the following hypothesis: Kids who view the LOOP animatic will demonstrate significantly better knowledge about specific science concepts than kids who do not view the animatic. This study provided evidence that the LOOP episode had a significant and positive impact on kids' ability to learn about science concepts. CEG found that kids who viewed the LOOP pilot episode demonstrated significantly better knowledge about specific science concepts than kids who did not. Kids who had watched the animatic were significantly more likely to report that there was water in the desert than kids who had not watched the pilot (75% vs. 34%); were able to describe what an oasis was (53% vs, 23%); and understood that water can be found underground (53% vs. 11%) or in an oasis (31% vs. 0%). Moreover, 82% of the kids in the study reported that the episode helped them learn that water is important. In addition to reporting that LOOP achieved its science content objectives, CEG found that LOOP was universally appealing across both genders, all races and ethnicities, all age groups, and all socioeconomic backgrounds, geographic regions, and settings (e.g., urban, suburban, rural): 91% reported that they liked watching the show. These evaluation findings, combined with the findings from the front-end needs assessment conducted for LOOP (also by CEG), helped solidify WGBH's goals and design for LOOP: LOOP's design and deliverables should expose children to ecosystems that are far away and close to home; parallels should be drawn between the familiar and the unfamiliar for example, all plants need water whether they live in a desert or in one's backyard; the project should demonstrate the interconnectedness of all living things by getting kids outdoors, investigating their own neighborhoods; ultimately, the project should show kids how to think more deeply and creatively about the world they live in, and to make choices based on what they discover.



Team Members

Christine Paulsen, Evaluator, Concord Evaluation Group
WGBH, Contributor


Funding Source: NSF
Funding Program: AISL
Award Number: 1010959
Funding Amount: 249254

Related URLs

LOOP: Season One


Audience: Elementary School Children (6-10) | Evaluators | Families | Museum | ISE Professionals
Discipline: Ecology | forestry | agriculture | Education and learning science
Resource Type: Evaluation Reports | Formative
Environment Type: Broadcast Media | Media and Technology

Linkedin   Youtube   Facebook   Instagram
Search: repository | repository and website pages | website pages
NSF logo

This material is supported by National Science Foundation award DRL-2229061, with previous support under DRL-1612739, DRL-1842633, DRL-1212803, and DRL-0638981. Any opinions, findings, conclusions, or recommendations contained within are those of the authors and do not necessarily reflect the views of NSF.

NSF AISL Project Meetings

Privacy Policy | Terms of Use | Contact Us