Head of AI Platform

ABOUT ABRIDGE

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh.

THE ROLE

Our generative AI-powered products bring joy back to the practice of medicine. As our offerings expand, we’re looking for a Head of AI Platform to scale the infrastructure that powers them. This is a critical, high-leverage role requiring both people leadership, technical strategy, and ownership of key business outcomes. You will own the entire lifecycle of our AI Platform, ensuring its reliability, efficiency, scalability, and compliance. You’ll own a key pillar of our technical organization, driving the technical direction and organization shaping how our models are trained, served, and managed in production.

WHAT YOU’LL DO

- People Management: Recruit, retain, and mentor engineers and engineering managers. Provide regular feedback; create opportunities for career growth; and foster a culture of collaboration and excellence.

- Technical & Organizational Leadership: Act as the people and technical leader for the AI Platform team. This includes owning the staffing and execution of the team, and driving work on model serving, training compute, agent serving platform, LLM gateway, and associated orchestration layers. You will guide architectural discussions and set top-level strategic direction for the company’s AI/ML infrastructure.

- Project Management: Work closely with stakeholders, including product managers, engineering managers, and AI/ML teams to plan, execute, and support multiple projects simultaneously. You will be responsible for the engineering process in the team and the output of the platform.

- Platform Ownership: Own the design, build, and operation of the core AI platform components, including:

- Model serving and deployment infrastructure.

- Compute and vendor management (e.g. GPU allocation).

- MLOps pipelines and tooling.

- Health, quality, and performance monitoring.

- Training compute infrastructure.

- LLM gateway and orchestration layers for agent serving.

- Champion Quality: Set a high standard for your team including software quality; communication; collaboration; and compliance with industry and regulatory standards.

WHAT YOU’LL BRING

- A strong technologist, with 10+ years of experience building high-performance distributed systems. At least 5+ years of management experience with 3+ years managing AI/ML-focused engineering teams.

- Comfortable giving constructive feedback on technical designs and code reviews.

- Skilled in building secure, compliant systems in major cloud platforms (GCP preferred, but other experience welcome).

- Skilled at hiring and mentorship, with a track record of helping engineers grow their skills and careers.

- Expertise with Kubernetes, containers, model training and serving, GPU-based capacity planning, and building applications on top of LLMs.

- Knowledgeable about the software development lifecycle. You view processes such as Kanban and Scrum as tools in a toolbox, and you know which tools to apply in which situations.

- Up-to-date on industry best-practices and tools, and enjoy learning new things

- Excited about being hands-on in a fast-moving, productive, and supportive environment

- Willing to pitch in wherever needed

- Has thrived in a fast-growing startup, knows how to operate in that environment

BONUS POINTS IF…

- Has owned an Evaluation Platform for AI/ML models.

- Has owned data engineering or core infrastructure.

WHY WORK AT ABRIDGE?

At Abridge, we’re transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We’re driving real, lasting change, with millions of medical conversations processed each month.

Joining Abridge means stepping into a fast-paced, high-growth startup where your contributions truly make a difference. Our culture re