On-the-Spot Feedback: Scientist Experience

February 20th, 2023 | EVALUATION

The On-the-Spot Feedback project was an iterative design and research project, which developed and tested a training model to help scientists build strategies to gather audience feedback into their outreach activities, allowing them to adjust and shift their communication and outreach on-the-spot, based on real time audience feedback.

This report presents the findings of the project's summative evaluation, which primarily addressed: How do scientists experience and respond to the process of encountering, learning, planning, and using (or not using) the OTSF approach?  Using data from post-training surveys and delayed follow-up interviews, which probed into each step in the journey of learning and applying the OTSF model.  The report covers: 1) Scientists overall reaction about the value of OTSF; 2) Immediate outcomes from the training; 3) Strengths and barriers in the training process; 4) Strengths and barriers in the planning process; 5) Strengths and barriers when applying OTSF in real settings.

This report provides an overview of the strengths, limitations, and future opportunities for applying this (and similar) models of embedded feedback in science communication, outreach, and engagement activities.

Note: Research being conducted concurrently within the OTSF project (by Oregon State University) will address the impacts on scientists skills, self-efficacy, and behaviors from learning the OTSF approach.

Document

OTSF-Scientist-Experience-Final-Report-FINAL.pdf

Team Members

Jessica Sickler, Evaluator, J. Sickler Consulting
Michelle Lentzner, Evaluator, J. Sickler Consulting

Citation

Identifier Type: doi
Identifier: 10.17605/OSF.IO/RTP4H

Funders

Funding Source: NSF
Funding Program: AISL
Award Number: 1811022

Related URLs

On-the-Spot Assessment to Improve Scientist Engagement with the Public

Tags

Audience: Scientists
Discipline: General STEM
Resource Type: Evaluation | Evaluation Reports | Summative
Environment Type: Professional Development | Conferences | Networks | Professional Development and Workshops