Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
We are looking for hands-on engineers who can lead support automation initiatives while personally designing and building AI solutions end-to-end. This is a role for someone who can identify support problems, build AI/automation solutions, deploy them to production, and continuously improve them.
Key Responsibilities
- Identify high-impact support processes for AI/automation.
- Design, build, integrate, test, and deploy AI-powered workflows and agents.
- Develop solutions using LLMs, RAG, AI agents, and workflow automation.
- Build end-to-end AI pipelines covering knowledge/data ingestion, orchestration, model execution, tools/actions, evaluation, and production monitoring.
- Integrate AI with CRM, ticketing, knowledge bases, and internal tools.
- Monitor AI quality, accuracy, cost, latency, and business impact; continuously improve solutions.
- Partner with Product and Engineering to drive AI-led transformation.
Ideal Experience
- 3+ years overall experience in software engineering, AI/ML, automation, technical operations, or support technology.
- 2+ years of hands-on Generative AI/LLM application development, with demonstrated production experience.
- Experience in automation, integrations, or workflow engineering.
- Strong experience taking AI/automation projects from concept and architecture through production and continuous improvement.
Must-Have Skills
- Strong Python and/or JavaScript/TypeScript.
- LLM APIs and Generative AI application development.
- RAG, embeddings, vector databases, and knowledge pipelines.
- AI agents, agentic workflows, tool/function calling, and MCP.
- End-to-end AI/LLM pipelines: ingestion → orchestration → model → tools/actions → evaluation → production.
- REST APIs, webhooks, SQL, and system integrations.
- LLM evaluation, observability, guardrails, monitoring, and cost/latency optimization.
- Production deployment, CI/CD, and troubleshooting of AI/automation systems.
- Strong understanding of customer-support workflows and automation opportunities.
Preferred
- Experience with OpenAI/Anthropic/Claude/Gemini, Claude Code, LangChain/LangGraph, LlamaIndex, n8n/Make/Zapier/Power Automate, vector databases, AI evaluation/observability tools, AWS/Azure/GCP, Docker, and CRM/helpdesk platforms such as Zendesk, Salesforce, Jira, Freshdesk, or Zoho.
What We Are Looking For
A builder, not just a strategist. The candidate should demonstrate real AI/automation solutions they have personally built or led, explain the architecture and their contribution, and quantify business impact such as automation %, ticket deflection, average handle time (AHT) reduction, cost savings, or productivity gains.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
More Openings at CertifyOS
Explore Top Companies in this Space
Verantos
Life Sciences / Real-World Evidence / Data Analytics / Healthcare
Claritas Rx
Healthcare / Data Infrastructure and Analytics / AI / Specialty Pharmacy
BioIntelliSense
Digital Health & Remote Patient Monitoring (RPM) / Medical Wearables & Clinical Intelligence / Healthcare AI & Predictive Data Analytics
SOPHiA GENETICS
Healthcare / AI / SaaS / Data Analytics
CertifyOS
View Company ProfileCertifyOS (operating at certifyos.com) is a provider data infrastructure platform engineered for streamlined healthcare provider verification. Founded in 2021 by Anshul Rathi, Simon Maas, Nick Helfrich, and Zoltan Gombosi and headquartered in New York, CertifyOS eliminates fragmentation and reduces costs by ingesting, cleansing, normalizing, and validating data from a wide range of sources. Under the hood, CertifyOS's Provider Hub uses best-in-class technology and deep domain expertise to facilitate real-time verification of Primary Source Verifications (PSV). This allows healthcare providers to streamline their operations and improve patient care. Backed by investors including Transformation Capital, General Catalyst, and Upfront Ventures.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.

