Back to Jobs
Hippocratic AI
AI & Machine Learning 2d ago

Senior Forward Deployed Engineer

Hippocratic AI
United StatesUnited States
Full-time
Not Disclosed
Senior-Level

Job Description

Key Skills Required

Master these to land this role

Prompt EngineeringBestseller πŸ”₯
Learn in 22 Hours
Machine LearningBestseller πŸ”₯
Learn in 42 Hours
NLPPython ScriptingAI Engineer

Want to know if you're a match for this job?

Calculate My Match Score

What Success Looks Like

Cutting-Edge AI Innovation: You design sophisticated AI solutions using advanced LLM techniques (multi-turn reasoning, complex RAG, LLM-as-judge); solve novel healthcare AI challenges that move the category forward.

Proactive Problem-Solving: You identify customer issues early through deep monitoring and proactive communication, often solving problems before they impact clinical operations.

Advanced System Design: You architect complex AI systems with sophisticated RAG pipelines, nuanced tool-calling strategies, and advanced LLM techniques that solve novel customer problems.

Production Excellence: You own production reliability across multiple deployments, anticipate failure modes, implement proactive monitoring, and drive continuous reliability improvements.

Technical Leadership: You serve as the technical authority for complex, novel deployments; guide architectural decisions; mentor other engineers on AI techniques.

Customer Technical Partnership: You partner with sophisticated customer IT teams on complex challenges, explaining architectural choices, and collaborating on optimizations.

Core Responsibilities

  • AI Innovation & Architecture – Design cutting-edge AI solutions to novel healthcare challenges; architect advanced RAG, tool-calling, and LLM technique approaches.
  • Advanced RAG System Design – Design and implement advanced retrieval-augmented generation systems; optimize for relevance, latency, and cost; handle complex data sources and sophisticated chunking strategies.
  • Advanced LLM Techniques – Apply sophisticated LLM engineering patterns (LLM-as-judge, multi-turn reasoning, complex prompt engineering); optimize agent behavior for production reliability.
  • Proactive Customer Problem-Solving – Anticipate customer issues; propose proactive AI-driven solutions; identify optimization opportunities.
  • Production Architecture & Operations – Design infrastructure for high-reliability AI systems; implement comprehensive monitoring, logging, and incident response; ensure systems meet production standards.
  • Complex Deployments – Lead technical execution for sophisticated, novel deployments; own integration architecture; solve complex AI challenges creatively.
  • Team Mentoring & Technical Leadership – Mentor junior FDEs on AI development and production patterns; contribute to technical standards and best practices.

What You Bring

Must Haves

  • 5-7 years of software engineering experience with expert-level Python and production software systems expertise.
  • Advanced hands-on experience with LLM frameworks (LangChain, LangSmith); deep understanding of RAG, tool calling, and advanced LLM patterns; experience solving novel AI problems.
  • Proven ability to architect and implement complex AI systems; experience designing systems for reliability and scale.
  • Experience with sophisticated integrations and enterprise systems; strong understanding of systems reliability, error handling, and operational patterns.
  • Bachelor's degree in Computer Science or related field from a top-ranked university.

Nice to Haves

  • Experience designing and optimizing advanced RAG systems at scale; deep knowledge of retrieval strategies, embedding models, or vector databases.
  • Hands-on experience with Model Context Protocol (MCP) or similar sophisticated tool integration approaches.
  • Healthcare IT experience (EHR integrations, FHIR, HL7, healthcare data standards).
  • Experience mentoring engineers or leading technical initiatives; contributions to AI/ML open source projects.
  • Track record of driving innovation in AI systems or solving novel technical challenges.

Why Hippocratic AI

  • You're architecting the future of AI in healthcare. You're designing sophisticated systems that solve cutting-edge healthcare AI challenges. Your RAG architectures, tool-calling patterns, advanced LLM techniques, and production systems directly transform healthcare operations at scale. This is architectural-level impact on healthcare innovation.
  • You work with world-class AI engineers and clinical experts. The team includes AI pioneers from Google, Meta, Microsoft, NVIDIA and clinical leaders from Johns Hopkins, Washington University, Stanford. You'll tackle the hardest AI innovation problems with the sharpest minds. You'll grow faster here than almost anywhere.
  • Backed by $404M from top-tier AI and healthcare investorsβ€”CapitalG, a16z, General Catalyst, plus health system validators like UHS, Cincinnati Children's, WellSpan. You're not betting on unproven ideas; you're building on validated market demand and deep institutional support. Focus on technical excellence at scale.
  • This is category creation in AI-native healthcare delivery. You're defining how LLM agents interact with healthcare systems, how sophisticated RAG enables clinical AI, how to deploy advanced AI techniques safely. You're writing the playbooks. Every system you build contributes to transforming how healthcare uses AI.

If you've built production AI systems, thrive at the edge of technical and human complexity, and want your work to matter in the most direct sense possible β€” we'd like to meet you.

How would you rate this job post?

See what other professionals think about this role.

banner
logo

Hippocratic AI

View Company Profile

Hippocratic AI (operating at hippocraticai.com) is a healthcare technology company engineered for developing safety-focused large-language models for medical applications. Founded in 2023 by Munjal Shah and Vishal Parikh, Hippocratic AI is headquartered in Not specified, Hippocratic AI does X instead of Y β€” develops safety-focused large-language models for medical applications, solving the problem of improving patient care with AI. Under the hood, the company uses NVIDIA technology and is deployed on AWS to help shape the future of patient care. This allows health systems, payors, and pharma to improve patient care with AI. Backed by leading investors, including General Catalyst, Andreessen Horowitz, Premji Invest, and others.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More