Back to Jobs
Karbon
AI & Machine Learning 1d ago

AI Infrastructure & Governance Lead

Karbon
United StatesUnited States
Full-time
$180,000–$190,000 USD
Senior-Level

Job Description

Key Skills Required

Master these to land this role

Machine Learning41mFree Trial ✨
Start 10-Day Free Trial
Python ScriptingAPI IntegrationAI EngineerGovernance

Want to know if you're a match for this job?

Calculate My Match Score

Karbon is the global leader in AI-powered practice management software for accounting firms, serving tens of thousands of professionals across 40 countries. With a globally distributed team and a people-first culture, Karbon is ranked #1 on G2, growing rapidly, and recognized as a Great Place To Work®.

Karbon is pioneering AI adoption across all departments, with hundreds of workflows built in-house. The next phase is scaling AI infrastructure, governance, and measurable ROI. This role focuses on extending existing AI capabilities, ensuring trustworthy systems, and proving their impact.

Key Responsibilities:

  • Ship internal automations and agents that eliminate manual work across Sales, Customer Support, Implementation, Support, and Operations. Integrate AI with existing systems via APIs and MCP servers.
  • Build a data gateway acting as a routing proxy between Claude and internal data sources, with Okta authentication and RBAC enforcement. Ensure audit logging and spend attribution. Deploy within 30 days.
  • Develop department-specific tools: renewal risk signals for CS, proposal draft automations for Sales, SOW generators with scope-creep flags for Implementation, and ticket triage routers for Support.
  • Prototype quickly, harden tools in use, and delegate ownership to respective teams.

Governance & Visibility:

  • Manage Claude access, provisioning, and Slack workflows for seat requests, model access, and connector approvals.
  • Run a connector security review pipeline in partnership with Security.
  • Own the spend dashboard for all AI tools (Claude, Cursor, Codex, Linear AI, etc.), ensuring department leaders see their own metrics weekly.
  • Extend visibility into an ROI framework: adoption rate, hours saved, cost per seat, and project-level impact. Partner with Finance for budget accountability.
  • Lead the AI champions program (14 department champions) for peer enablement, skill submissions, and offboarding flows to capture and reassign work.
  • Build and maintain an AI wiki with per-department documentation of tools, use cases, and skills.

Training & Standardization:

  • Collaborate with department leads to establish AI usage standards and enforce them.
  • Conduct practical, repeatable training sessions to optimize workflows and reduce costs.
  • Maintain a shared library of prompts, skills, and patterns to retain knowledge post-employee departure.
  • Automate parts of the skill review pipeline.

Measurement & Reporting:

  • Define key metrics for AI effectiveness: cost, adoption, delivery, and quality.
  • Build data pipelines for these metrics, expecting messy source data. Publish regular reports to executives with consistent formatting.
  • Eliminate metrics that do not influence decisions within a quarter.

Qualifications:

  • Shipped production software in the last 2 years, writing code in Python or TypeScript, using SQL, and REST APIs.
  • Built a real-world application on top of a large language model (not just a demo), with users, error handling, and cost control.
  • Worked directly with non-technical teams (e.g., CS renewal motions, implementation scoping) as the technical point of contact.
  • Can derive numbers from messy data and present them to a CFO.
  • Led a cross-functional program (e.g., champion network, adoption initiative) with participants not reporting to you.
  • Communicates clearly and prioritizes impactful work.

Bonus: Experience in accounting, professional services, or B2B software. Familiarity with MCP server development, Claude API, or agent frameworks. Knowledge of Okta or similar identity providers.

Success Metrics:

  • By month 6: Three automations in production, owned by respective teams. All department leaders have access to AI usage and cost data. Spend dashboard is live and trusted. Executive report is debated, not acknowledged. Gateway has Security sign-off.
  • By month 12: Cost per unit of work is improving. Three departments extend and run their own tools independently. Onboarding includes AI workflow training. Champion pods manage skills without direct oversight. AI wiki is maintained by department owners.

Why Join Karbon?

  • Global experience across Australia, New Zealand, UK, and Canada.
  • Competitive benefits: 4 weeks flexible time off, medical/dental/vision coverage, 401(k) matching, 8 weeks paid parental leave, work-from-home stipend.
  • Collaborative, diverse, and high-performing team culture.
  • Fast-growing company with internal promotion opportunities.

How would you rate this job post?

See what other professionals think about this role.

banner

Karbon (operating at karbonhq.com) is a collaborative practice management platform engineered for accounting firms. Positioned as the leading solution in its space, Karbon consolidates teamwork, client interactions, and operational systems into a unified ecosystem. While traditional accounting firms often rely on fragmented tools—spanning email, spreadsheets, and disparate software—Karbon streamlines workflows by integrating communication, task management, and document handling within a single interface. Under the hood, the platform leverages automation and real-time collaboration features, enabling teams to discuss work directly within emails, notes, and tasks. This allows accounting, bookkeeping, and tax professionals to enhance visibility, operational efficiency, and connectivity across their entire firm, ultimately reducing administrative overhead and improving client service. Though specific funding details remain undisclosed, Karbon’s market positioning as the #1-ranked platform underscores its rapid adoption among modern accounting practices.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More
AI Infrastructure & Governance Lead at Karbon | HireSkys