Life Sciences Researcher & Subject-Matter Expert for AI Evaluation Benchmark

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

The Role

We are looking for experienced Life Sciences researchers and subject-matter experts to create advanced scientific reasoning tasks for an AI evaluation benchmark focused on biology and related disciplines.

This is a non-coding research role. The work centers on designing rigorous, self-contained scientific problems based on realistic experiments, biological data, figures, sequences, structures, literature-style evidence, and research scenarios. The goal is to create tasks that test whether AI systems can genuinely interpret evidence, reason scientifically, and synthesize information, rather than simply recall facts.

Relevant backgrounds include Molecular Biology, Genetics & Genomics, Cell Biology, Biochemistry, Neuroscience, Microbiology, Immunology, Evolutionary Biology, Ecology, Structural Biology, Biophysics, Developmental Biology, Cancer Biology, Pharmacology, and related fields.

Key Responsibilities

• Design challenging life-sciences reasoning problems for AI evaluation.
• Create tasks based on realistic experiments, biological datasets, figures, sequences, structures, and scientific evidence.
• Write questions with clear, objectively defensible answers.
• Develop rigorous expert reference answers explaining the required scientific reasoning.
• Ensure tasks test interpretation and synthesis, not simple factual recall.
• Validate biological claims, calculations, assumptions, and conclusions.
• Identify ambiguity, alternative valid interpretations, and poorly constrained questions.
• Build tasks that meaningfully differentiate advanced AI models based on scientific reasoning ability.
• Incorporate reviewer feedback while maintaining high quality and throughput.
• Document tasks clearly and reproducibly where applicable.

Requirements

• PhD, postdoctoral experience, or equivalent advanced research experience in the Life Sciences.
• Deep expertise in at least one biological discipline.
• Strong ability to interpret scientific experiments, data, and research findings.
• Strong understanding of experimental design and scientific reasoning.