Manager, Data Science

At MCG, we lead the healthcare community to deliver patient-focused care. We have a mission-driven team of talented physicians and technical experts developing our evidence-based content and innovating our products to accelerate improvements in healthcare. If you are driven to enhance the US healthcare system, MCG is eager to have you join our team. We cultivate a work environment that nurtures personal and professional growth, and this is a thrilling time to become a part of our organization. With dynamic roles that offer meaningful impact, you'll be able to fully realize your potential. Plus, you'll enjoy world-class benefits and the security, stability, and resources of our parent company, Hearst, with over 100 years of experience. As Manager, Data Science, you will lead the team responsible for effectively testing our agents. You will lead Data Scientists and analysts as they build statistically sound evaluations, guide annotation, and develop ground truths for complex tasks. You Will:

• Direct annotation by managing annotation budgets, sourcing data, and providing statistical analysis of annotations
• Maintain and expand metrics used to evaluate agent performance and fairness
• Create evaluation packages for Data Scientist and Machine Learning Engineers to use when running experiments
• Ensure accurate, regular reporting on evaluation metrics to stakeholders
• Manage periodic re-evaluation of production agents using user data and annotation

Our tech stack

• Primarily Python jobs and applications
• OpenAI and other Foundation model APIs
• Pytorch on AzureML for our own training
• Kubernetes via AKS or EKS for serving compute (with support from infra team)
• Databricks for data lake
• Flyte for orchestration

What We're Looking For:

• Expert level Python proficiency
• Ability to write reliable, extensible python packages
• Demonstrated experience translating high level requirements into useful tools
• Excellent knowledge of frequentist and Bayesian statistical techniques
• Healthcare experience
• Good written communication skills

Preferred Qualifications:

• Experience with basic principles of deep learning and/or natural language processing
• Experience working specifically on automated model evaluation

Pay Range: $154,300 - $216,000 Other compensation: Bonus Eligible/ Commission Eligible Perks & Benefits: 💻 Remote work ✈️ Travel expected 3-4 times per year for company-sponsored events 🩺 Medical, dental, vision, life, and disability insurance 📈 401K retirement plan; flexible spending and health savings account 🏝️ 15 days of paid time off + additional front-loaded personal days 🏖️ 14 company-recognized holidays + paid volunteer days 👶 up to 8 weeks of paid parental leave + 10 weeks of paid bonding leave  🌈 LGBTQ+ Health Services 🐶 Pet insurance  📣 Check out more of our benefits here: https://www.mcg.com/about/careers/benefits/ Remote with Occasional Travel (1–3 trips per year) MCG Health is a Seattle, Washington-based company and is considering remote candidates with some travel for company-sponsored events. The ideal candidate should be comfortable balancing the independence of remote work with the collaborative opportunities offered by periodic in-person engagements. We embrace diversity and equal opportunity and are committed to building a team that represents a variety of backgrounds, perspectives, and skills. Only with diverse thoughts and ideas will we be able to create the change we want in healthcare. The more inclusive we are, the better our work will be for it. All roles at MCG are expected to engage in occasional travel to participate in team or company-sponsored events for the purposes of connection and collaboration. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. MCG is a leading healthcare organization dedicated to patient-focused care. We value our employees' unique differences and are an Equal Employment Opportunity (EEO) employer. Our diverse workforce helps us achieve our goal of providing the right care to everyone. We welcome all qualified applicants without regard to race, religion, nationality, gender, sexual orientation, gender identity, age, marital status, veteran status, disability, pregnancy, parental status, genetic information, or political affiliation. We are committed to improving equity in healthcare and believe that a diverse workplace fosters curiosity, innovation, and business success. We are happy to provide accommodations for individuals. Please let us know if you require any support.