NFB STEM2U Regional Evaluation Report: Baltimore

As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6. During this first regional workshop in Baltimore, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for a group of teachers who work with visually impaired students. A fourth program, for Port Discovery museum staff, was conducted earlier to prepare the museum staff to assist with the youth program. The youth program involved small groups of youth working with blind teen mentors to complete STEM-related activities both onsite at the NFB headquarters and at Port Discovery children’s museum. Both the parent/caregiver and teacher programs focused on connecting parents and teachers to the NFB network and the resources it offers. Additionally, the parent/caregiver program shared ideas on how parents/caregivers could advocate for their child’s rights in the school setting, while the teacher program focused on alternative techniques they could use to help students succeed in STEM learning. The museum staff program increased museum staff members’ awareness of issues faced by blind visitors to the museum, and provided strategies to assist blind museum visitors explore STEM concepts. The evaluation questions for this program were: 1. What happens in the regional programs for each of the audiences? 2. What are perceptions of each audience in terms of appropriateness, value, and intentions emerging from the regional program? 3. In what ways does each audience see the program affecting their work (adult audiences) or their potential educational and career paths (youth)? 4. How does this experience affect the individual and their understanding of blind youth and STEM? The Lifelong Learning Group was contracted to conduct an evaluation for the grant, focusing on the affective outcomes of the project through youth and adult perceptions of the efficacy and value of the training and experience from their various perspectives. Methods Data for this program evaluation were collected from five different audiences using three methods. Data for the youth program, which involved activities both onsite at the NFB headquarters and at Port Discovery children’s museum, were collected from the youth, their parents/caregivers, and the teen mentors. Data for the parent/caregiver, teacher, and museum programs were collected from those specific audiences. During the course of the regional programs, the evaluation team observed the parent, teacher, and youth programs in order to note the flow and intersections of the sessions and how different components serve the desired outcomes from a design perspective. During each program, evaluators did pulse interviews, asking participants questions in order to track connection to the program. At the conclusion of the program, the younger participants were invited to respond to questions about the program using an oral questioning route. The teen and adult participants were invited to respond to computer-based questionnaires tied to each of the programs (teen mentors, parent/caretaker, teacher, and science-museum staff) at the final program meeting and via e-mail from the NFB staff. Data were analyzed collectively. During analysis, categories of participant responses about their knowledge were developed inductively through the coding process (i.e., they emerged from the data itself rather than being prescribed). Quantitative data were analyzed using the Statistical Package for the Social Sciences (SPSS); descriptive statistics were used to present overall patterns in the data.