Senior Data Consultant - Azure Synapse to Microsoft Fabric Migration

Core Responsibilities

Trility Consulting is seeking an experienced Senior Data Consultant to support a client engagement focused on modernizing an existing Azure Synapse data platform and migrating prioritized workloads to Microsoft Fabric.

In this role, you'll partner with Trility consultants and client engineers to:

• Pressure-test and refine the Fabric architecture, including metadata structures, table-level event triggering, and reusable ingestion patterns
• Build reusable, metadata-driven ingestion frameworks that allow new tables and sources to be onboarded through configuration rather than custom development
• Migrate data workloads into a modern lakehouse environment using PySpark and Spark SQL
• Develop scalable data pipelines and establish automated CI/CD workflows for reliable deployment from development through production
• Leverage Claude Code for AI-assisted development, including code generation, review, and quality assurance

Key Tasks

• Evaluate and refine existing Microsoft Fabric architecture, including metadata structures and ingestion patterns
• Design and implement a metadata-driven ingestion framework for configuration-based onboarding
• Migrate prioritized data sources and workloads from Azure Synapse to Microsoft Fabric
• Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL
• Analyze existing Azure Synapse pipelines and translate complex workflows into Fabric solutions
• Build data validation and reconciliation processes for migration accuracy, including duplicate detection and record-level comparisons
• Implement Git-based CI/CD workflows using GitHub Actions or Azure DevOps for Fabric artifacts
• Evaluate data dictionary, metadata, and lineage requirements, including Microsoft Purview catalog solutions
• Collaborate with client engineers through paired development, code reviews, and knowledge-sharing sessions
• Apply data engineering best practices for performance, testing, monitoring, documentation, security, and operational support

Required Experience

• 5+ years of experience with Azure Data Services, including Microsoft Fabric, Azure Data Factory, Databricks, or Synapse
• Hands-on experience with Microsoft Fabric in production environments, including lakehouses, pipelines, notebooks, medallion architecture, and capacity management
• Strong experience building and maintaining production ETL/ELT pipelines and reusable data ingestion frameworks
• Experience designing and implementing a metadata-driven ingestion framework with configuration-based onboarding
• Experience developing Spark notebooks and data transformation workflows using PySpark and Spark SQL
• Strong SQL skills for data transformation, validation, and performance tuning, including T-SQL logic
• Experience with Azure Synapse, including analyzing complex data processing dependencies
• Experience implementing medallion architecture patterns (Bronze, Silver, Gold)
• Experience with Git-based CI/CD workflows for data platform artifacts
• Hands-on experience using Claude Code for AI-assisted software development
• Experience validating data migrations and ensuring data quality, accuracy, and consistency
• Experience integrating data from REST APIs, relational databases, and structured/semi-structured data sources
• Familiarity with data governance, lineage, metadata management, and data catalog concepts
• Strong collaboration skills with technical teams and client-facing discussions

Preferred Experience

• Experience migrating data platforms or workloads from Azure Synapse to Microsoft Fabric
• Experience with Oracle and DB2 data sources
• Experience implementing incremental ingestion, change data capture (CDC), and source-specific loading strategies
• Experience developing data reconciliation and validation frameworks for large-scale migrations
• Experience evaluating Microsoft Purview or other data catalog and lineage solutions
• Experience working within consulting or professional services environments