Direct and Unobtrusive Measures of Informal STEM Education Outcomes

March 1st, 2019 | RESEARCH

The free‐choice nature of informal STEM education (ISE) makes rigorous and contextually appropriate evaluation of outcomes challenging. Traditional measures such as surveys and interviews have been widely used in ISE evaluations, but they have limitations: They are typically self‐reports that are susceptible to the reactive effects of measurement, and they tend to intrude upon the participant's learning experience. The ISE field needs measures that capture outcomes in more direct and less obtrusive ways, permitting triangulation with multiple measures on outcomes. In this chapter, we define what we mean by direct and unobtrusive measures, and we discuss the feasibility and future of using such measures in ISE evaluations by drawing on examples from the field. We include a case study in which we adapt a school‐based performance assessment to embed into the informal learning experiences of participants at a STEM tinkering workshop; and we highlight successes, challenges, and implications for the future.

Document

(no document provided)

Team Members

Alice Fu, Author
Archana Kannan, Author, Stanford University
Richard Shavelson, Author, Stanford University

Citation

Identifier Type: DOI
Identifier: 10.1002/ev.20348
Identifier Type: ISSN
Identifier: 1534-875x

Publication: New Directions for Evaluation
Volume: 161
Page(s): 35-57

Related URLs

Full Text

Tags

Audience: Evaluators | Museum | ISE Professionals
Discipline: Education and learning science
Resource Type: Peer-reviewed article | Research Products
Environment Type: Exhibitions | Informal | Formal Connections | Media and Technology | Public Programs