ML Engineer (LLM, RAG & Data Pipelines)

IDT Corporation, a global communications and financial services leader (NYSE listed, $1.5 Billion Revenue), is seeking a skilled Data/ML Engineer to join their Business Intelligence (BI) team. You will take an active role in designing the architecture that powers LLM-driven applications, AI-based BI, and enterprise data warehouses. This is a chance to build end-to-end pipelines for Retrieval-Augmented Generation (RAG) workflows and vector search.

Key Responsibilities

• LLM & RAG Pipelines: Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
• Generative AI Ops: Define processes for prompt engineering, orchestration flows, and model fine-tuning to power conversational interfaces.
• Data Engineering: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery into centralized feature stores.
• Unstructured Data: Build workflows for extracting and storing semantic representations of unstructured data for advanced search.
• Analytics Architecture: Architect lightweight analytics solutions that deliver natural language query experiences and AI-backed insights.

Requirements

• Experience: 5+ years of history building scalable data/ML infrastructure.
• Core Tech: Demonstrated experience utilizing Python for large-scale data processing and transformation.
• AI Architecture: Deep understanding of Vector Databases, RAG architectures, and integrating open-source LLM frameworks.
• Big Data: Hands-on experience with Apache Spark, Hadoop, and Kafka for real-time ingestion.
• Database: Mastery in SQL/PLSQL and cloud data warehouses like Snowflake or Redshift.
• Cloud: Experience with AWS or Azure Machine Learning for managed LLM deployments.
• Language: Excellent English communication skills (Oral & Written).

Nice to Have

• Experience with LangChain, LlamaIndex, and DataStax AstraDB.
• Familiarity with Hugging Face Transformers and LLaMA-4 fine-tuning.
• Knowledge of MLOps tooling and CI/CD pipelines for model versioning.

What We Offer

• Remote Freedom: Maximum flexibility in choosing your location within India.
• Compensation: Competitive salary (B2B Contract) with annual performance reviews.
• Equipment: Really good hardware provided.
• Growth: Compensation for professional training, seminars, and conferences.