Search Resource Library (Repository)

Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the...

  The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of...

In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise. You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations,...

Scientific societies, associations, and professional organizations have unique opportunities to foster a culture of “civic science” — broad public engagement with issues that arise at the many intersections of science and society. As linchpins of the scientific enterprise, these organizations engage in a variety of activities to this end, including programs focused on science communication, public engagement, informal education, outreach,...

YR Media (formerly Youth Radio) engages young people in digital media production that combines journalism, design, data, and coding. With support from the National Science Foundation (NSF), YR Media collaborated with the Massachusetts Institute of Technology’s App Inventor to launch WAVES — A STEM-Powered Youth News Network for the Nation. This three-year initiative expanded YR Media’s model of informal STEM...

This evaluation brief summarizes the kinds of formative feedback and resources that Rockman et al evaluators provided to inform content and marketing of two science cafés, and support the construction, refinement, and dissemination of a questionnaire about café participants understanding of Science Technology and Society (STS).  REA staff members served as educational assessment consultants who worked with the project team to (a) qualitatively assess...

This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs. ...

This assessment is based on the three vertices of a triangle composed of cognition, observation, and interpretation, all of which converge on the nature of science, the relevance of science to everyday life, and decision-making behaviors. We chose one measure from Conley, Pintrich, Vekiri, & Harrison (2004).  This measure encompasses four dimensions about scientific knowledge -- source, certainty, development and justification --...

The September 6 -7 COMPASS Conference held at the Exploratorium had 19 speakers and 80 attendees.  The conference purpose was to take a focused look at indoor location aware mobile (ILAM) technology and how it was used in science centers and other museums. The three primary project goals were: 1) Form an integrated vision by consolidating expertise from disparate disciplines connected to...

Intellectual Merit: Project RESET utilized a responsive teaching approach to engage youth in critical STEM literacy on the topic of climate change. Video recordings of the afterschool program, artifacts from the program, and interviews with youth were analyzed to better understand how youth supported each other’s participation in science discourse. The team outlined four themes of critical STEM literacy (CSL)...

Youth from non-dominant racial and linguistic backgrounds often have limited access to school science learning opportunities. Afterschool settings may provide learning environments in which they improve science knowledge and construct positive science identities. With this premise, our research team designs and provides a community-based afterschool program that engages resettled Burmese refugee youth in STEM learning. In this paper, we seek to understand how refugee youth utilize...

This document contains a description and summaritve evaluation information for the TV Weathercasters and Climate Education award, including impacts of the program on television weathercasters and on their public audiences. The project team documented substantial increases in both the science-based views and climate reporting practices of TV weathercasters. They also found that viewers appreciated climate reporting by local TV weathercasters, feeling...

The Science Fairs Under the 'Scope Study's key findings are summarized here on the topics of: Models And Elements Of Middle School Science Fairs Science And Engineering Practices Cost Of Science Fairs Parent Involvement In Science Fairs Science Interest And Identity. ...

We collected data from middle school science fairs held in schools across the country to understand: What are the basic models and elements of middle school science fairs; If and how science fairs increase students’ interest in science, technology, engineering or math (STEM) and/or STEM careers If and how participation in select models of middle school science fairs enhance students’ mastery of the...

This project asks the question: are there duties and tasks consistent across job descriptions of those who work in informal science learning institutions, and do those duties and tasks change over the course of a career? This is being done to critically look at professional development for science and technology centers and think critically about the career path needs of...

This project promises to help professionalize the field of informal science learning. In general, professional fields that developed guidance for growth and excellence tend to attract and retain professionals more successfully than those who do not, in part because expectations are transparent. Our analyses thus far included a variety of potential target audiences who engaged with the Framework at differing...

This project promises to help professionalize the field of informal science learning. In general, professional fields that developed guidance for growth and excellence tend to attract and retain professionals more successfully than those who do not, in part because expectations are transparent. Our analyses included a variety of potential target audiences who engaged with the Framework at differing depths. In...

A Teen Science Café is an out-of-school program that brings together teens and science professionals to engage in discussion and activities related to the scientist’s work.  The Cafés are highly interactive, incorporating hands-on activities and discussion with scientists; each is co-organized by an adult and a group of Teen Leaders.  The model was developed and refined in several different locations...

A Teen Science Café is an out-of-school program in which teens and STEM experts engage in conversation and activities to explore a topic related to the STEM professional’s expertise.  Teen Science Cafés are independently run and organized at more than 100 sites nationwide – from museums to libraries to aquariums.  Prior evaluation of the Teen Science Café model has demonstrated...

In this article we explore how activity design and learning contexts can influence youth failure mindsets through a case study of five youth who described failure as sometimes a good thing and sometimes a bad thing (a perspective we characterize as Failure as Mosaic, described in the article). These youth and their descriptions of failure-positive and failure-negative experiences offer a unique...

Seeking to use narrative as a vehicle for getting more young people interested in STEM, the National Science Foundation supported a WETA/PBS NewsHour initiative to adapt their Student Reporting Labs (SRL) curriculum to feature a focus on STEM content in 2015. NewsHour selected Knology to run a four-year evaluation of the project from 2015 to 2019. Building on earlier research about student-led...

The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part...

The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one...

The independent evaluation firm Knight Williams, Inc. administered an online survey to educators from 16 SciGirls CONNECT2 partner organizations to gather information about their anticipated use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with...

The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was...