Funding from a US Department of Education i3 validation grant was provided to expand the reach of UPSTART to children from rural districts in Utah who have traditionally had less access to educational resources. UPSTART is a computer-based in-home program designed by the Waterford Institute to provide preschool-age children with reading instruction. To study the program’s effectiveness, ETI designed a longitudinal, experimental research design. Evaluation findings will be used by educators, researchers, and practitioners, and will inform a national evaluation of all i3 grant projects.
The California Environmental Education Foundation (CEEF) is committed to providing professional development opportunities for teachers that promote ecological understanding, stewardship of the environment, and environment-based practices in the classroom and beyond. ETI will be working with CEEF to evaluate the 2013 Teacher PD Institute, and will focus on understanding the ways in which the knowledge and skills gained through the PD program influences teaching and students’ attitudes and behaviors towards the environment and learning in the classroom.
The Academy of Motion Picture Arts and Sciences (AMPAS) contracted with ETI to evaluate the impact of their Media Literacy Program (MLP), a program designed to increase the awareness and analytical skills of students encountering media messages. MLP brings together 11th grade students in the Los Angeles area for 3 days of group discussions, film clip analyses, a feature film screening and filmmaker visits. To evaluate the program ETI will conduct observations and develop student surveys to document the growth and development resulting from participation in the MLP for two program cohorts.
ETI partnered with National Geographic Society’s Educational Programs (NGEP) to develop a comprehensive evaluation strategy for their fledgling Massive Open Online Course (MOOC), "Water: The Essential Resource". The course was designed to increase environmental education in classrooms across the state of California in support of the Education and the Environment Initiative (EEI). The evaluation was designed to serve 3 purposes: 1) to improve the pilot program prior to full-scale implementation, 2) to review and pilot test outcome evaluation methods in a MOOC, and 3) to study the participant outcomes of the full program (October 2014). ETI designed and administered surveys and presented the findings to NGS in three reports. Findings were used to improve the course prior to its full-scale launch and to document participant outcomes in the full program.
Loveisrespect.org (LIR) is the ultimate source for support, tools and services to help young people prevent and end dating abuse. ETI has developed survey instruments to examine the change in website users understanding of and attitudes toward abuse. In addition, we have developed a framework that takes into account user behaviors.
Use of a process evaluation design to document the critical process and milestones of committees as they develop recommendation frameworks to influence public policy in the geographic sciences.
In the summer of 2012, the Kidspace children’s museum opened its newest exhibit, the Galvin Physics Forest (Physics Forest), which features thirteen new hands-on exhibits to engage visitors. ETI developed an impact evaluation plan for substantive study of the exhibit’s effects on their target audience. Our evaluation plan consisted of a program-level logic model, an evaluation design, procedures for data collection analysis, and an evaluation toolkit with sample instruments.
United Friends of the Children (UFC) is a non-profit organization dedicated to improving the lives of foster youth through programs that help foster youth become successful, independent adults. UFC contracted the Evaluation and Training Institute (ETI) to conduct a needs assessment for alumni program services, as well as to provide information on service utilization.
Arts Insights is an arts education program focusing on the performing arts and English language arts designed for K-12 students. The program model includes classroom curricular materials, a performance, and a classroom artist visit. ETI developed a series of teacher and student surveys to document the program’s successes and challenges in terms of implementation, curricular materials, and learning goals.
In 2007, the Evaluation and Training Institute (ETI) was contracted by the CTAA to conduct a multi-year evaluation of the National Resource Center's (NRC) activities, as well as the implementation and effectiveness of the United We Ride Coordination Ambassador Network. To evaluate the UWR Ambassadors’ activities and accomplishments, we collected a satisfaction questionnaire from a sample of technical assistance recipients. Respondents answered open-ended questions about the nature and quality of the technical assistance provided to them by their respective regional Ambassador. These first-hand accounts from technical assistance recipients provide direct feedback about the Ambassadors, independently substantiating the latter’s efforts and effectiveness.