Evaluation Specialist, Division of Education and Training
Boston, MA The Fenway Institute
Job Type
Full-time
Description

The Evaluation Specialist is responsible for designing and monitoring the successful execution of all evaluation plans and activities across the Division of Education and Training. Evaluation activities include the measurement of 1) internal continuous quality improvement, 2) program exposure and process outcomes, and 3) program effectiveness outcomes. 


The Division of Education and Training provides educational programs, resources, and consultation to health care organizations and providers across the U.S. and globally, with the goal of optimizing quality, culturally responsive and cost-effective health care for lesbian, gay, bisexual, and transgender, queer, intersex, asexual, and all sexual and gender minority (LGBTQIA+) people.  


This is a grant-funded position for a limited time with the possibility of extension.


Representative Duties:

  1. Manages evaluation plans
  • Develops and oversees the execution of evaluation plans for the full range of education and training programs
  • Develops and oversees the execution of internal continuous quality improvement for the Division of Education and Training
  • Oversees data management procedures and tools (e.g., database)
  • Develops and manages the collection and analysis of participant pre- and post-training surveys 
  • Develops and manages the collection and analysis of data collection tools to measure participant registration and attendance, participant exposure, dissemination of educational materials, and other data as needed

2. Collaborates with key partners and colleagues to implement evaluation plans

  • Collaborates with the Technical Manager to perform evaluation related to the online learning management system and website
  • Collaborates with program managers to design data collection instruments and to ensure data is collected consistently and accurately
  • Collaborates with members of Fenway Health’s data team to develop data collection tools and perform complex data analyses as needed

3. Oversees data quality control

  • Oversees coding, entering, and cleaning of data
  • Performs regular data quality checks 
  • Ensures adherence to ethical standards (e.g., confidentiality of data) 
  • Implements processes to ensure consistency in data collection, analysis, and storage

4. Develops and presents evaluation reports

  • Provides regularly scheduled progress reports on evaluation plan implementation and outcomes to the Division of Education and Training
  • Writes evaluation reports as needed for funders
  • Presents findings to program staff and at meetings and conferences

5. Meets Agency Participatory Expectations:

  • Adheres to all agency and departmental policies and procedures
  • Participates in quality assessment and improvement activities as requested
  • Adheres to established safety policies, procedures and precautions
  • Attends all required meetings, in-services and professional trainings
  • Maintains professional competence necessary to perform job responsibilities; maintains and provides agency with records of continuing education activities
  • Serves on agency committees and in professional organizations when requested

6. Performs other related duties as required

Requirements
  • Bachelor’s degree and at least four years’ relevant experience in program evaluation
  • Ability to work harmoniously and effectively with colleagues, patients, clients and vendors across the spectrum of diversity, including but not limited to race, ethnicity, color, gender identity, sexual orientation, age, socio-economic status, national origin and immigrant status, religious or spiritual identity, disability (physical, mental, emotional and developmental), veteran status, and/or limited English proficiency.
  • Willingness to contribute towards Fenway’s efforts in becoming an anti-racist organization and promoting a culture dedicated to ongoing development in service of humility, equity, diversity, inclusion, and belonging, where differences are acknowledged and valued.

Preferred Qualifications:

  • Proficiency in quantitative and qualitative evaluation methods and survey design
  • Proficiency in descriptive and basic inferential statistical methods
  • Proficiency in Excel, Survey Monkey, and Redcap (can be trained to use Redcap)
  • Excellent attention to detail
  • Excellent communication skills
  • Excellent writing skills
  • Excellent organizational skills
  • Knowledge of and sensitivity to diverse communities, particularly communities of color and LGBTQIA+ communities 
  • Ability to work harmoniously with diverse groups of individuals required

Physical Requirements:

Ability to meet the following physical requirements with or without reasonable accommodations:

  • Sit at a computer station for extended periods of time
  • Ability to type on a keyboard for extended periods of time

Supervisory Responsibility

  • None
We offer competitive salaries, and for those who qualify, an excellent benefits package; including comprehensive medical and dental insurance plans, and a retirement plan with employer match. We also provide 12 paid holidays, paid vacation, and more.LGBTQIA+ identified persons, Black, Indigenous, and other people of color (BIPOC), and individuals from other historically underrepresented communities are strongly encouraged to apply.