February 20th, 2023 | EVALUATION
The On-the-Spot Feedback project was an iterative design and research project, which developed and tested a training model to help scientists build strategies to gather audience feedback into their outreach activities, allowing them to adjust and shift their communication and outreach on-the-spot, based on real time audience feedback.
This report presents the findings of the project's summative evaluation, which primarily addressed: How do scientists experience and respond to the process of encountering, learning, planning, and using (or not using) the OTSF approach? Using data from post-training surveys and delayed follow-up interviews, which probed into each step in the journey of learning and applying the OTSF model. The report covers: 1) Scientists overall reaction about the value of OTSF; 2) Immediate outcomes from the training; 3) Strengths and barriers in the training process; 4) Strengths and barriers in the planning process; 5) Strengths and barriers when applying OTSF in real settings.
This report provides an overview of the strengths, limitations, and future opportunities for applying this (and similar) models of embedded feedback in science communication, outreach, and engagement activities.
Note: Research being conducted concurrently within the OTSF project (by Oregon State University) will address the impacts on scientists skills, self-efficacy, and behaviors from learning the OTSF approach.
Document
OTSF-Scientist-Experience-Final-Report-FINAL.pdf
Team Members
Jessica Sickler, Evaluator, J. Sickler ConsultingMichelle Lentzner, Evaluator, J. Sickler Consulting
Citation
Identifier Type: DOI
Identifier: 10.17605/OSF.IO/RTP4H
Funders
Funding Source: NSF
Funding Program: AISL
Award Number: 1811022
Related URLs
On-the-Spot Assessment to Improve Scientist Engagement with the Public
Tags
Audience: Scientists
Discipline: General STEM
Resource Type: Evaluation | Evaluation Reports | Summative
Environment Type: Professional Development | Conferences | Networks | Professional Development and Workshops