Back to Jobs
Openrouter
Development 1h ago

Software Engineer - Trust & Safety (Abuse Prevention & Fraud Detection)

Openrouter
United StatesUnited States
Full-time
Not Disclosed
Mid-Level

Job Description

Key Skills Required

Master these to land this role

Next.js1h 32mFree Trial ✨
Start 10-Day Free Trial
Backend42mFree Trial ✨
Start 10-Day Free Trial
SQL15 minFree Trial ✨
Start 10-Day Free Trial
React57mFree Trial ✨
Start 10-Day Free Trial
AI & Machine Learning

Want to know if you're a match for this job?

Calculate My Match Score

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers—without lock-in, capacity constraints, or unnecessary cost. We power the most advanced AI teams in the world by giving them the flexibility to move fast, scale confidently, and stay future-proof as models evolve.

As enterprise adoption of AI accelerates, OpenRouter sits at the center of how organizations operationalize LLMs across research, product, and production workloads.

About the Role

We’re hiring a Software Engineer on our Trust & Safety team to own the detection, enforcement, and review systems that keep abuse, fraud, malicious users, and illegal content off the platform. Millions of LLM requests and a large volume of payments flow through OpenRouter every day, and maintaining the safety, integrity, and trust of our platform is a priority. You’ll build the systems that detect abuse and fraud, the heuristics for automated action and abuse mitigation, the tooling our reviewers act through, and the guardrails that keep us from acting on the wrong account.

You will be responsible for proactive abuse-prevention architecture for a new layer of the AI stack while the abuse patterns are still being invented. The threat model changes quickly, and the systems you build have to catch novel abuse without adding friction for the legitimate developers and enterprises who use our platform. Done well, this work protects millions of daily requests, our provider relationships, and the trust that enterprises place in OpenRouter.

This is a hands-on individual contributor (IC) role with broad surface area spanning the inference path, the payments path, internal review tooling, and the data platform underneath all of it. There is little process between you and shipping, and your work has direct consequences for real users, so the bar for judgment is high.

What You’ll Do

  • Build and operate technical systems across signup, payments, and usage to detect abuse and fraud early.

  • Own the technical enforcement pipeline end to end, from detection proposing a candidate to a human reviewing it to restrictions landing across our systems.

  • Build the internal tools that support investigation and enforcement decision-making. This involves building case queues, evidence summaries, bulk review and enactment, and alerting mechanisms to trigger investigations.

  • Ship technical solutions for content safety on the inference path: illegal content detection and reporting, the KYC systems or external intelligence sources to allow us to more efficiently and proactively detect and stop fraud and abuse.

  • Help make abuse uneconomical by building systems, tools, and heuristics for quick detection and scalable enforcement.

  • Help investigate incidents directly in the data and build the analytics plane so we can quickly establish what happened, size the pattern, and separate real abuse from a false-positive cluster.

  • Build defensible monitoring for risk, abuse spikes, and fraud, all while reducing false positives.

  • Set the technical direction for how we prevent abuse as the platform grows and evolves, and define the patterns other engineers build against.

  • Work with data scientists on feature exploration and training of risk and abuse ML models.

What We’re Looking For

  • 4+ years building and operating production systems, ideally including work in trust & safety, fraud, payments risk, security, or anti-abuse.

  • Proficient in React, TypeScript, Next.js, and JS runtimes.

  • Ability to write SQL against large event datasets and reason about base rates, precision and recall, and the cost of a wrong decision.

  • Sound judgment when working with incomplete evidence.

  • High agency and a bias toward action; spotting problems, iterating, and shipping without waiting for tickets.

  • AI-forward in your workflow, using coding agents often, finding interesting ways to automate your work, and holding opinions about what works and what doesn't.

  • Comfortable in a small, fast-moving environment where boundaries between teams are intentionally fluid.

  • Discretion and resilience, since parts of this role may involve reviewing or discussing disturbing content and handling sensitive user data.

  • Strong written and verbal communication, able to explain incident findings, detection rules, and systems to a range of audiences.

  • Motivated by adversarial problems, where the counterparty adapts to whatever you ship and the work keeps evolving.

Nice to Haves

  • Experience with payments fraud tooling (Stripe Radar, chargeback and dispute flows, crypto payment risk), or with identity and KYC systems.

  • Experience with LLM-specific abuse: jailbreaks, prompt injection, key theft and resale, shared or scraped credentials, automated account farming.

  • Experience operating large-scale analytical datastores (e.g., ClickHouse, BigQuery) and observability platforms.

  • Familiarity with the reporting and compliance obligations that come with hosted AI, including illegal content reporting and model provider policy requirements.

  • Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling.

How would you rate this job post?

See what other professionals think about this role.

banner

Openrouter is a pioneering technology firm that specializes in the development of innovative, open-source router solutions. With a strong commitment to advancing networking technology, the company's mission is to provide high-quality, customizable, and cost-effective routing products that cater to a wide range of applications and industries. By leveraging the power of open-source software and collaborative development, Openrouter aims to democratize access to advanced networking capabilities, fostering a community-driven approach to innovation. The company's products and solutions are designed to be highly scalable, secure, and reliable, making them an attractive choice for businesses, organizations, and individuals seeking to enhance their network infrastructure. Through its dedication to openness, transparency, and community engagement, Openrouter is poised to revolutionize the networking landscape, empowering users to take control of their digital connectivity and unlock new possibilities for growth, collaboration, and innovation.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More