AI Radiology Evaluation Expert (Radiologist)
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
We're collaborating with a leading AI research lab to develop rigorous evaluations of how well AI interprets real radiology studies. The focus is on ensuring AI not only describes images fluently but also makes the clinically critical decisions—such as measurements by the correct convention, interval changes against prior studies, and structured categorization in borderline cases—where expert judgment is essential.
This is not about image labeling. Instead, it involves capturing the reasoning radiologists perform daily into reference standards that train and test advanced AI models.
Requirements
What you'd do:
- Read de-identified studies (including CT, MR, radiography, ultrasound, PET/CT, mammography, and more) and write the reference report or highlight specific findings.
- Apply structured systems and measurement conventions used in practice, such as RECIST, Lung-RADS, BI-RADS, CAD-RADS, ASPECTS, and others.
- Review AI-generated interpretations and identify inaccuracies, unsupported claims, or unsafe conclusions.
- Contribute cases that challenge even strong AI models.
Who we're looking for:
- Board-certified or board-eligible radiologists (e.g., ABR, FRCR, EDiR, or international equivalents). Residents and fellows in later stages of training may also be considered.
- Any diagnostic sub-specialty, including neuro, chest, abdominal, MSK, breast, cardiac, nuclear medicine, pediatric, and others.
- Currently reading studies or recently in active practice.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
Senior Product Manager (AI & Growth Infrastructure) at Hilbert
Hilberts AI
United StatesAdvanced LLM Power User - AI Evaluation Specialist
weekday
United StatesClinical Documentation Reviewer (Primary Care Physician) for Healthcare AI Partner
weekday
United StatesClinical Documentation Review Specialist (MD) for Healthcare AI Partner
weekday
United StatesMore Openings at Weekday
Switzerland-Based Native Swiss German Voice Actor for AI Research Lab
Weekday
SwitzerlandPhysician Survey Specialist for Ulcerative Colitis Market Research
Weekday
United StatesCastilian Spanish Voice Actor for AI Audio Data Improvement
Weekday
United StatesVP/Sr. Director of Revenue Cycle (AI Research Collaboration)
Weekday
United StatesExplore Top Companies in this Space
WorkMotion
HR Tech & Global Employment Platforms
TestGorilla
HR Tech / Recruitment / Talent Acquisition
Meet Dex
Agentic Recruitment & HR Tech / AI Sourcing & Talent Matching / Enterprise B2B SaaS / Technical Career Platforms
Somewhere
Recruiting / HR Tech / Remote Work
Weekday
View Company ProfileWeekday is an AI-powered recruitment platform designed to act as a fully automated outbound sourcing engine. Instead of posting a job on traditional boards and waiting for active job seekers to apply, Weekday empowers companies to proactively hunt top-tier tech talent. They maintain a massive database of over 250 million profiles (heavily focused on the US and India) complete with verified contact data. Their AI contextually screens candidates to find the perfect fit, and then the platform automatically runs personalized, multi-channel outreach campaigns to engage those passive engineers and bring them directly into your interview pipeline.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.