Expert Reviewer for Legal AI Benchmarking (Japanese Law)

We are partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Japanese law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.

Requirements

What you'll do:

• Run the same set of prompts across two AI (LLM) platforms
• Compare the outputs from both platforms side by side
• Score each response against a standardized rubric we provide
• Submit concise written feedback for every evaluation

Requirements:

• 5+ years as in-house legal counsel practicing in Japan
• Strong command of Japanese law, especially commercial and contract matters
• Sharp attention to detail and precise written communication
• Able to work independently to a rubric and to deadlines

Logistics:

• Initial commitment: ~10 hours, with strong potential for more
• Confidentiality: all work is covered by NDA

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.