CEC Technical Reports

From the DPC Coordination and Evaluation Center at UCLA

CEC technical reports on this page include:

  • Evaluation of Post-secondary Student Outcomes: Underrepresented (URG) and Well-Represented (WRG) Group Variable Construction in the Enhance Diversity Study using the November 2019 NIH Guidelines
  • Development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) Scale
  • Short-Form of the Mentoring Competency Assessment (MCA-short)
  • BUILD Program Evaluation: Case Study Analysis
  • BUILD Program Evaluation: Identification of Comparator Institutions

Evaluation of Post-secondary Student Outcomes: Underrepresented (URG) and Well-Represented (WRG) Group Variable Construction in the Enhance Diversity Study using the November 2019 NIH Guidelines

 

This technical report details coding recommendations for well-represented groups (WRG) and under-represented groups (URG) that are consistent with groups that the National Institutes of Health (NIH) have identified as underrepresented in the biomedical research enterprise. Specifically, the report describes the coding of WRG and URG being implemented in the consortium-wide survey data that is being used in the DPC-wide evaluation.

Download PDF Version

Development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) Scale

 

This technical report provides an overview of the development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) scale. The 5-item scale currently appears as an additional module on the Higher Education and Research Institute (HERI) Faculty Survey 2019-2020 for the 10 BUILD programs within the Diversity Program Consortium and that are participating in the Enhance Diversity Study, supported by the National Institutes of Health (NIH U54GM119024). The piloted scale is meant to measure DPC Hallmark of Success FAC-16: “Strong self-efficacy to act as a change agent to enhance diversity in biomedical research and research training environments” (DPC, 2019). Once data are available, scale validation will move forward and findings will be shared.

See the Full Text

Short-Form of the Mentoring Competency Assessment (MCA-short)

 

The original Mentor Competency Assessment (MCA) scale was published as "The mentoring competency assessment: validation of a new instrument to evaluate skills of research mentors" in 2013 by Fleming et al. in Academic Medicine, a Journal of the Association of American Medical Colleges. The 26-item scale measured six sub-domains of mentor competency: maintaining effective communication, aligning expectations, assessing understanding, addressing diversity, fostering independence, and promoting professional development. The original MCA was used in the national longitudinal Enhance Diversity Study (Building Infrastructure Leading to Diversity (BUILD) Faculty Annual Follow-up Survey 2017-2108 and 2019; National Research Mentoring Network (NRMN) Annual Follow-up Survey 2016-2017, 2017-2018, and 2019) as part of the evaluation of the Diversity Program Consortium, supported by the National Institutes of Health (NIH U54GM119024).

See the Full Text

BUILD Program Evaluation: Case Study Analysis

 

Funded by the National Institutes of Health (NIH), Building Infrastructure Leading to Diversity (BUILD) features a set of 10 linked awards granted to undergraduate institutions, each of which developed approaches intended to determine the most effective ways to engage students from diverse backgrounds in biomedical research. These awards also intend to prepare students to become potential future contributors to the NIH-funded research enterprise. The Coordination and Evaluation Center (CEC) at UCLA has been charged with conducting a longitudinal, multi-method evaluation of the BUILD programmatic interventions designed to diversify the biomedical workforce (Davidson, Maccalla, Afifi, et al., 2017). This technical report documents the methodology for the qualitative analysis employed by the CEC case study evaluation team. See our other white paper for details on the protocols and data collection process.

See the Full Text

BUILD Program Evaluation: Identification of Comparator Institutions

 

Funded by the National Institutes of Health (NIH), BUILD (BUilding Infrastructure Leading to Diversity) is a set of experimental training awards designed to learn how to attract students from diverse backgrounds into the biomedical research workforce and encourage them to become future contributors to the NIH-funded research enterprise. There are 10 primary BUILD grantees that include 11 institutions. This technical report describes the procedures used to identify comparator institutions for each of the BUILD institutions and reports the number and characteristics of the matched institutions. In particular, we describe (1) the formation of the candidate pool of potential comparator institutions; (2) the institutional characteristics used as matching variables; (3) the use of a matching procedure called coarsened exact matching to identify potential comparator institutions matched to BUILD schools; (4) refinement of the comparator list based on qualitative review; and (5) the final list of BUILD and comparator institutions. Due to confidentiality concerns, names or other identifying information of the comparator institutions are not provided.

See the Full Text

The Diversity Program Consortium Coordination and Evaluation Center at UCLA is supported by Office of the Director of the National Institutes of Health / National Institutes of General Medical Sciences under award number U54GM119024.
Need Assistance? Please contact our support team: info@diversityprogramconsortium.org .