What are the responsibilities and job description for the Mid-Level Product Manager, Evaluation & Data Generation position at Jobright.ai?
Verified Job On Employer Career Site
Job Summary:
Hippocratic AI is a company focused on developing a safety-oriented Large Language Model for healthcare, aiming to enhance health accessibility and outcomes globally. They are seeking a Product Manager to lead the development of their model evaluation and data generation platform, ensuring the creation of high-quality datasets that inform the model's roadmap and maintain safety in healthcare applications.
Responsibilities:
• Define the strategy and architecture for model evaluation across agent behaviors.
• Collaborate with data scientists, ML engineers, and clinicians to craft robust benchmarks.
• Design and manage internal and external workflows for data labeling and generation.
• Monitor data quality and iterate on tooling and process efficiency.
• Work closely with the model training team to align data feedback loops with product performance.
Qualifications:
Required:
• 3 years in product management with experience in ML evaluation, labeling, or data pipelines.
• Familiarity with language model datasets, especially in high-stakes or regulated settings.
• Experience collaborating with labeling vendors, data QA teams, or managing Mechanical Turk-style pipelines.
• Attention to detail in process design and tooling for human-in-the-loop systems.
Company:
Hippocratic AI is a healthcare technology company that develops safety-focused large-language models for medical applications. Founded in 2023, the company is headquartered in Palo Alto, California, USA, with a team of 51-200 employees. The company is currently Growth Stage. Hippocratic AI has a track record of offering H1B sponsorships.
