PathMaker Scholars Program
5-Year Comprehensive Evaluation
Demonstrating the Value of Systematic Program Evaluation
Project Type: Comprehensive Evaluation
Keywords: Evaluation, Longitudinal, Mentorship, STEM Identity, Belonging
The Challenge
The PathMaker Scholars team faced a critical challenge: without systematic evaluation, their program lacked evidence of its impact and clear direction for growth. To address this, we partnered with them to develop an evaluation approach that would do more than just measure outcomes at the end—it had to work alongside the program itself.
We designed an evaluation framework that assessed effectiveness across multiple cohorts of scholars, tracked participant outcomes longitudinally, and surfaced issues early enough to enable real-time course corrections. This continuous feedback loop allowed us to make evidence-based decisions for ongoing program enhancement while also building a strong evidence base for stakeholders and funders.
The SSLC Approach
Our solution was a five-year comprehensive mixed-methods evaluation plan designed to capture the full picture of program impact. We administered validated pre/post surveys to both scholars and mentors, and conducted focus groups at mid-program and end-of-program to gather deeper qualitative insights. By pairing mentor and mentee perspectives, we compared experiences and identified alignment challenges or gaps in the mentoring relationship.
The evaluation tracked consistent measures across five cohorts from 2021 to 2025, allowing for meaningful longitudinal analysis while providing real-time feedback through timely reports. This enabled program leaders to make immediate course corrections rather than waiting until the end of a cohort. Key constructs we measured included STEM identity, research skill confidence across ten competencies, sense of belonging in science, grit and personal agency, mentorship quality from both perspectives, and career aspiration development.
The Results
Scholar Outcomes
60% planning graduate school, 40% planning health professional school
Science identity strengthened across all 6 measured dimensions
Research confidence increased in all 10 skill areas
Mentorship Qaulity
100% mentor satisfaction with program
100% willing to participate again
86% of scholars met or exceeded mentor expectations
100% rated lab training as adequate
Actionable Insights
Evaluation-Driven Improvements: From Problems to Solutions
Early program evaluation identified critical issues. Subsequent years show documented improvements based on SSLC recommendations.
VALUE CREATED FOR Huntsman Cancer Institute (HCI)
Real-time course correction — Timely evaluations catch issues early
Documented evidence base — 5 years of data for funders
Continuous improvement cycle — Findings → Recommendations → Implementation → Outcomes
Multi-perspective validation — Scholars, mentors, and program managers all surveyed
Scalable best practices — Documented what works for replication
Voices from the Program
Scholar Transformation
“I can confidently say that I will go into biomedical sciences and that this is where I belong!”
“PathMaker has given me a new sense of belonging to a whole new world of science.”
“This program will change your life. Yes it is hard and you completely get out of your
comfort zone but it is so rewarding.”
“Providing opportunities for early career trainees is one of the most important/impactful things we can do.”
Conclusion
Evaluation isn't just about measuring impact, it's about creating it.
This 5-year evaluation demonstrates that systematic, mixed-methods program evaluation creates tangible value: it identifies problems early, guides evidence-based improvements, documents impact for stakeholders, and builds an increasingly effective program over time. The PathMaker Scholars Program's trajectory from Year 1 challenges to Year 5 successes showcases the power of evaluation-informed continuous improvement
