Back to Jobs
Synthesia
AI & Machine Learning 5d ago

Research Scientist in Interactive Avatars (AI Video Agents)

Synthesia
United StatesUnited States
Full-time
Not Disclosed
Senior-Level
VT

Does Synthesia sponsor H-1B visas?

Check real filing data, salaries & approval rates on VisaTalentUSA

View Data →

Job Description

Key Skills Required

Master these to land this role

Computer Vision3h 51mFree Trial ✨
Start 10-Day Free Trial
Machine Learning41mFree Trial ✨
Start 10-Day Free Trial
TensorFlowAI EngineerNLP

Want to know if you're a match for this job?

Calculate My Match Score

About the Role

As a Research Scientist, you will join a team of 40+ researchers and engineers in our R&D department, working on the frontier of generative AI with a focus on avatar-centric, interactive video diffusion models.

This is a unique opportunity for experts in machine learning and diffusion models to shape the future of AI video agents that listen, respond, and react like humans. As part of our Interactive Avatars team, you'll build models that hold natural, real-time conversations: understanding what a user says and how they say it, then responding with appropriate turn-taking, backchannels, gaze, and facial and body reactions. You'll join a team that moves fast, iterates often, and turns breakthrough research into product capabilities that ship.

What You'll Do

  • Contribute to the research direction for dyadic interaction modeling, and own well-scoped research problems end to end.

  • Advance the state of the art in the perceptual layer of interactive agents, including understanding user audio and video and generating contextually appropriate reactions.

  • Post-train multimodal models to generate rich, natural dyadic interactions from user audio and video inputs.

  • Adapt diffusion models to new conditioning signals, such as conversational state, turn-taking, and listener cues.

  • Build robust evaluation frameworks and test suites for continuous tracking of interaction quality.

  • Partner with our data team to define data needs and shape high-quality datasets.

  • Run rigorous experiments, and share findings that inform the team's technical decisions.

What We're Looking For

  • A strong ML background and hands-on experience with diffusion models, ideally for video or avatar generation.

  • Publications at top-tier venues (e.g., CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH) in areas such as world models, dyadic interaction, or video diffusion, or equivalent demonstrated impact.

  • Experience taking research ideas through to working implementations, and motivation to see them reach production.

  • Proficiency in PyTorch and modern ML tooling for large-scale training.

  • Clear communication of hypotheses, experiments, and results.

Nice to Have

  • Experience with real-time or streaming generation, including autoregressive video diffusion.

  • Distillation or other techniques for low-latency inference.

  • Audio-driven facial, gesture, or full-body motion modeling.

  • Conversational modeling, such as turn-taking, backchanneling, or listener-response generation.

  • Experience mentoring students or junior researchers.

Why Join Us?

  • Build production-scale video foundation models in a fast-growing Generative AI company.

  • Work on human-centric video generation with real-world impact.

  • Tackle hard problems in scaling, stability, and controllability.

  • Influence the direction of next-generation synthetic human technology.

  • Join a highly technical, high-ownership environment where your work ships.

How would you rate this job post?

See what other professionals think about this role.

banner

Synthesia (operating at synthesia.io) is a synthetic media-generation platform engineered for businesses to create professional videos without cameras, microphones, actors, or studios. Founded in 2017 by a team of researchers and entrepreneurs from UCL, Stanford, TUM, and Cambridge and headquartered in London, United Kingdom, Synthesia transforms text scripts into presenter-led videos using AI avatars. Under the hood, the platform leverages advanced AI to generate lifelike audio-visual agents and cloned avatars, enabling users to produce high-quality video content at scale. This allows corporate clients—including over 90% of the Fortune 100, such as Amazon, Zoom, and Microsoft—to streamline training, onboarding, and internal communications. Backed by over $537 million in funding across multiple rounds, including a $200 million Series E at a $4 billion valuation, Synthesia is positioned as a category leader in AI-driven video production for enterprise applications.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More