University of Texas at El Paso NSF CTGC Evaluation:

The University of Texas at El Paso (UTEP) has engaged Evaluand to provide an independent evaluation of their Community-driven Inclusive Excellence and Leadership Opportunities in the Geosciences (CIELO-G) project, as funded under the National Science Foundation’s Cultural Transformation in the Geoscience Community (CTGC) program.

CIELO-G, through formation of cohorts of graduate students, postdoctoral scholars, and local educators, aims to transform the culture of their local geoscience community to address fundamental climate change and Earth system science problems with local educators in a bi-national community. Outcomes anticipated from the model include (1) increasing the number and success rate of students from diverse socio-economic backgrounds pursuing geoscience careers, (2) growing awareness of the importance of geosciences among underserved groups in the community, and (3) bolstering graduate and postdoc scholar training through evidence-based professional development of technical and soft skills. The model applies a Collective Impact approach, creating mixed-stakeholder cohorts to undertake integrated efforts for community research and engagement with five local non-government organizations.

Evaluand is providing an external evaluation of UTEP’s community-driven STEM education efforts, applying a collaborative approach to document project implementation, test the theoretical model embedded in the CIELO-G program design, and assess the team’s success nurturing the five conditions of the Collective Impact framework. Outcomes being measured – in terms of persistent changes for UTEP faculty and researchers, community college and high school educators – include increased understandings of the current state and importance of geosciences research, soft skills (e.g., communication, organization), and technical proficiencies furthering students’ progress toward geosciences professions. Success for public audiences and NGOs is defined in terms of engagement, awareness, and understandings related to geosciences. Quantitative data is being collected through questionnaires and rubric/checklist scoring of stakeholder products and performances. These measure are complemented by qualitative evidence elaborating on the quality of delivery of, and outcomes from, CIELO-G activities. Analysis will apply a concurrent triangulation mixed design to answer questions guiding the study.