Experience

Intention 2 Impact
• United States
• Research Services
• 1 - 100 Employee
• Evaluation Consultant

  • Jan 2020 - Present


Leap and Associates

• Evaluation and Program Development Consultant

  • Sep 2018 - Oct 2020

  This multi-year evaluation of a prison rehabilitation performing arts project included formative evaluation as well as program development activities. During the first year, a colleague and I collaborated with program staff to develop their first theory of change, and, through on-site interviews and observations with prison inmates, were able to validate the theory of change and identify outcomes associated with program participation. Program staff were able to draw from these findings to acquire a $500k grant to expand their offerings to program Alumni (i.e., those who had participated in the program while in prison and were now on parole or probation). During the second year, we applied an innovative systems-mapping tool to help inform the program’s strategic decision making and build evaluation capacity as they implement their Alumni network. This approach utilized multiple collaborative workshop sessions as well as a literature reviews and interviews and focus groups with network members and their families.



UpLabs

• United States
• Business Consulting and Services
• 1 - 100 Employee

• Independent Culture Consultant and Evaluator

  • Aug 2019 - Sep 2020

  During this project I collaborated with an organizational culture consultant to develop interventions aimed at improving the work culture of an international film studio with over 400 employees. To diagnose their culture needs we developed, implemented, and analyzed a research-based culture survey with a response rate of over 70%. Findings of this survey were disseminated in person to all staff and C-suite members. Following the development of a strategic plan, began working with the company’s strategic planning and operations department to develop interventions to address our culture recommendations. My role on this project included data collection and analysis, disseminating results, conducting literature reviews, protocol design, and ongoing consultation on various program interventions, training development, and designing and implementing a hiring process for a culture coalition with the intention of facilitating system-wide culture change.



The Claremont Colleges

• United States
• Civic and Social Organizations

• Evaluation and Needs Assessment Consultant

  • Feb 2019 - Aug 2020

  This project consisted of two consecutive years of evaluation for a multi-service program aimed at increasing college teachers' uses of evidence-based pedagogy, creating more inclusive classroom environments, and building professional connections across a multi-campus college community. The first year utilized focus group, interview, survey, and archival data to assess program engagement longitudinally, identified barriers and facilitators to utilization, explore the potential for program expansion, and provided a justification for more in-depth evaluation efforts. Following findings from year one, the second year consisted of a needs assessment aimed at addressing the unique and evolving supports needed by faculty and staff as they adjust their pedagogy amid the Covid-19 pandemic and social justice movement that occurred during 2020. We worked directly with staff to address their informational needs, coordinate data collection activities, and refine data collection instruments to create alignment between evaluation data and program goals. We also established a needs assessment committee and coordinated the use of existing data bases across various institutions to inform program data needs. I was engaged in every step of this process, including indicator development, data collection, and data analysis activities as well as frequent communication and coordination with program staff.



International Baccalaureate

• Case Study Report Manager

  • Dec 2016 - Sep 2018

  This 5-year formative / summative evaluation project assessed a recently revised educational curriculum program provided by the International Baccalaureate Organization. During this project, I engaged in data collection, management, and analysis activities. Over a two-year period, I conducted dozens of observations, focus groups, and interviews across ten sites in six countries. I then coordinated the translation and transcription of over 150 audio recordings with online contractors and personally hired, trained, and managed a team of Ph.D. students in the qualitative analysis of these documents. I combined these qualitative findings with quantitative survey data to produce a formative mixed-methods report for program leadership. This final report contained in-depth descriptions of program performance across a three-year period, factors that inhibited or promoted effective performance, accessible summaries and infographics, and evidence-based recommendations to support program and operational improvement.



National Forum for Heart Disease & Stroke Prevention

• United States
• Hospitals and Health Care
• 1 - 100 Employee

• Graduate Research Assistant

  • Jan 2017 - Aug 2018

  This project was a 1.5-year needs assessment of a pilot program in San Bernardino County to help heart failure patients manage their condition. We established an evaluation advisory committee to help implement the evaluation. The committee was composed of program planners, implementers, and community members, all of whom helped inform the development of evaluation questions, advise on data collection approaches, and provided access to desired participant populations. We consulted with advisory board members regularly throughout the evaluation and held quarterly meetings with the board to share preliminary findings and gain assistance in interpreting data. Additionally, I helped coordinate with hospital staff to secure permission to collect HIPPA-protected data from heart failure patients. I continually developed materials to communicate with the advisory board, the evaluation team, program stakeholders, and funders. These included frequent evaluation updates, email communications, PowerPoint presentations, infographics, and a final evaluation report. In addition to guiding these coordination and communication efforts, I executed a considerable portion of the evaluation activities. These included collecting, cleaning, merging, and analyzing quantitative and qualitative program data from multiple sources (i.e., program records, large-scale publicly available datasets, focus groups, interviews, program documents, patient data) to answer evaluation questions, inform report recommendations, and determine program viability.



Boeing

• United States
• Aviation and Aerospace Component Manufacturing
• 1 - 100 Employee

• External Training and Evaluation Capacity Building Consultant

  • Jan 2016 - Jun 2016

  At the request of training and development leadership at Boeing International, I collaborated with two Evaluation Ph.D. students to develop two 70-page evaluation-and-training-related instructional documents. These documents were part of a larger effort to build Boeing’s capacity to internally evaluate their training efforts. Accordingly, the language used was tailored to communicate fundamental evaluation principles to leadership and line workers alike. These reports covered topics such as 1) conducting needs assessments, 2) selecting training activities, 3) developing a theory of change, 4) developing evaluation questions, 5) choosing an evaluation design, 6) collecting and using evaluative data to make decisions, 7) identifying organizational mechanisms to utilize evaluative findings, and 8) organizational knowledge management.



PATTON STATE HOSPITAL

• United States
• Medical Practices
• 1 - 100 Employee

• Positive Workplace Consultant

  • Jun 2014 - Jul 2015

  In a consulting capacity, I worked with a fellow master’s student to conduct a diagnosis of a Program (i.e., building consisting of eight Units that provided psychiatric care for long-term forensic patients) at Patton State Hospital, educate hospital staff about the principles of positive psychology, and develop and implement a workplace intervention aimed at addressing issues that were uncovered during diagnosis. During the diagnosis phase, we conducted over 70 interviews with hospital staff and leadership and reported the results to a group of medical doctors. As part of ongoing education efforts, we held ongoing meetings, workshops, and presentation on principles of workplace motivation and positive psychology. Our final intervention was a four-day appreciative-based strategic planning meeting which was attended and acted upon by all Unit staff and Program Management. The impacts of this intervention, including a decrease in employ absence and a reduction of Unit-level incidences, were reported upon at the hospital’s annual forensic conference to a crowd of over 200.