AI Research Engineer - Pre-training (LLM)

Tether, the company behind the world's most trusted stablecoin (USDT), is expanding its empire into Tether Data and Tether Power. They are pioneering a global financial revolution and are now pushing the boundaries of AI. They are seeking an AI Research Engineer to drive innovation in architecture development for cutting-edge models (Small, Large, and Multi-modal). Your mission is to conduct pre-training on large, distributed servers equipped with thousands of GPUs.

Key Responsibilities

• Pre-training at Scale: Conduct pre-training of AI models on large, distributed servers equipped with thousands of NVIDIA GPUs.
• Architecture Design: Design, prototype, and scale innovative architectures (Transformers & Non-Transformers) to enhance model intelligence.
• Research & Experimentation: Independently execute experiments, analyze results, and refine methodologies for optimal performance (strengthening baselines, resolving bottlenecks).
• Optimization: Investigate, debug, and improve model efficiency and computational performance.
• System Advancement: Contribute to the advancement of training systems to ensure seamless scalability on target platforms.

Requirements

• Education: Degree in Computer Science; PhD in NLP, Machine Learning, or related field is ideal.
• Track Record: Solid track record in AI R&D with good publications in A conferences* (NeurIPS, ICML, ICLR, etc.).
• Scale Experience: Hands-on experience contributing to large-scale LLM training runs on distributed servers with thousands of GPUs.
• Tech Stack: Strong expertise in PyTorch and Hugging Face libraries.
• Deep Knowledge: Deep understanding of state-of-the-art Transformer and non-transformer modifications.
• Distributed Training: Familiarity with large-scale, distributed training frameworks and tools.

Why Join Tether?

• Resource Rich: Tether has massive financial backing, allowing them to acquire state-of-the-art infrastructure (Thousands of H100s/A100s) that few startups can afford.
• Global Talent: Work with a global powerhouse team remotely from every corner of the world.
• Innovation: Work at the intersection of AI, Peer-to-Peer technology (KEET), and Bitcoin mining energy solutions.