DEVISE: Developing, Validating, and Implementing Situated Evaluation Instruments

This development project will create, test, validate, and disseminate a suite of evaluation tools for use by professionals who are developing Public Participation in Scientific Research projects. The necessary evaluation tools for what participants learn or believe after participating in citizen science projects (called Public Participation in Scientific Research or PPSR) are generally unavailable to project managers where conference participants. The project will collect examples of cognitive and affective test instruments and try them out in citizen science projects underway. This project grew from discussions at a conference on Developing a Citizen Science Toolkit at Cornell in 2007 where participants noted that evaluation is the most challenging and least understood step in the process of project development. Thus to provide projects with the tools of evaluation that are relevant to the field itself and to the development of the projects on citizen science, the investigators intend to conduct a study to demonstrate how an evaluation framework can be used to assess the impact of projects by conducting evaluations and presenting them as case studies. The investigators will provide evaluation tools for project developers and will facilitate community discussion about the use of these materials. The project also will provide an evaluation of the procedures used to create the tool kit for investigators. The evaluators are expert professionals in the field of attitude measurement, cognitive measurement, informal science program creation, and citizen science management. The investigators will provide webinars for investigators planning to use the tool kit in their projects. This project is intended to strengthen the field of informal science education researchers and administrators by providing a source for acceptable measurement methods of the impact on the public of participating in a scientific research project.