Spyhounds Pilot: Evaluation Report

January 1st, 2012 | EVALUATION

Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the kids and parents at the end of the pilot test to assess changes in knowledge, attitudes, and interest as well to gather subjective data on their experiences with the Spyhounds resources that can be used as formative data for development of future resources. The final sample contained 115 children across 21 states. Kids ranged in age from 5-8, with an average age of 7. The sample was evenly split between boys (n = 57) and girls (n = 58). The racial and ethnic background of the families in our sample mirrored national proportions: White (n = 85, 73.9%), Hispanic (n = 16, 13.0%), Black (n = 15, 13.0%), Asian (n = 10, 8.7%), Native American or American Indian (n = 2, 1.8%). Most parents reported that their family income was average, but the sample did include a range of socioeconomic levels: Better than the average family (n = 25, 21.7%), Same as the average family (n = 78, 67.8%), Worse than the average family (n = 12, 10.4%). About half of the kids had watched FETCH! with Ruff Ruffman prior to the study. The survey used in this study is included in the appendix of the report.

Document

Spyhounds_Evaluation.pdf

Team Members

Christine Paulsen, Evaluator, Concord Evaluation Group
WGBH, Contributor

Funders

Funding Source: NSF
Funding Program: AISL
Award Number: 1114690
Funding Amount: 253963

Related URLs

SPYHOUNDS

Tags

Access and Inclusion: Asian Communities | Black | African American Communities | Ethnic | Racial | Hispanic | Latinx Communities | Indigenous and Tribal Communities
Audience: Elementary School Children (6-10) | Evaluators | Families | Museum | ISE Professionals | Parents | Caregivers
Discipline: Education and learning science | Physics
Resource Type: Evaluation Reports | Formative | Research and Evaluation Instruments | Survey
Environment Type: Games | Simulations | Interactives | Media and Technology | Websites | Mobile Apps | Online Media

Linkedin   Youtube   Facebook   Instagram
Search: repository | repository and website pages | website pages
NSF logo

This material is supported by National Science Foundation award DRL-2229061, with previous support under DRL-1612739, DRL-1842633, DRL-1212803, and DRL-0638981. Any opinions, findings, conclusions, or recommendations contained within InformalScience.org are those of the authors and do not necessarily reflect the views of NSF.

NSF AISL Project Meetings

Privacy Policy | Terms of Use | Contact Us