Senior Backend Engineer (AI Infrastructure)

About Sentient: Sentient is advancing and empowering the development of open-source artificial general intelligence (AGI). We build research, products, and frameworks that help developers and researchers push the boundaries of AI in the open. Our mission is to enable a future where the development of AGI is shaped by a broad community of contributors.

Backed by leading investors including Founders Fund, Pantera, and Framework, we’re bringing together a team to tackle fundamental challenges in open-source AI. Join us to help build the tools and technology that make this future possible.

Responsibilities:

• Design, implement, and maintain fault-tolerant core infrastructure for the Sentient platform
• Architect and manage robust performance-critical backend services on AWS and GCP
• Implement serverless architectures and optimize cloud resource utilization
• Implement and maintain REST and Websocket APIs to provide data to AI applications
• Collaborate with cross-functional teams to define, design, and ship new features
• Design and deploy scalable, reliable, and secure end-to-end AI workflows, including fine-tuning and inference pipelines for generative AI models
• Design and implement custom AI agent frameworks and multi-agent systems from scratch
• Deploy, test, and follow proper release management processes to drive end-to-end services from dev to UAT to production
• Deploy services in accordance with security measures, including IAM, security groups, and encryption
• Write comprehensive documentation to ensure reproducibility and transparency

Required Qualifications:

• 5+ years hands-on experience in developing large applications and designing end-to-end infrastructure
• Demonstrated mastery of the Python programming language
• Expertise in a wide range of AWS and GCP services, including:
• Compute: EC2, GCE, Lambda, Cloud Functions
• Networking: VPC, Cloud VPN, Transit Gateway, Cloud Interconnect
• Storage: S3, Cloud Storage, EBS, Persistent Disk
• Databases: RDS, Cloud SQL, DynamoDB, Bigtable
• Containerization: ECS, GKE, ECR, Container Registry
• Serverless: Lambda, Cloud Functions, API Gateway, Cloud Run
• Monitoring: CloudWatch, Cloud Monitoring, CloudTrail, Cloud Audit Logs
• Expertise in containerization (Docker) and orchestration (Kubernetes, EKS, GKE)
• Familiarity with Infrastructure as Code (Terraform, CDK, Cloud Deployment Manager)
• Understanding of Generative AI, LLMs, datasets, fine-tuning, and AI inference
• Problem-solving mindset to navigate ambiguity in a fast-paced startup
• Passion for building revolutionary AI products