Azure Senior Data Engineer

Role Overview

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Azure cloud services to join our distributed team. In this role, you will be responsible for designing, developing, and maintaining scalable and robust data pipelines and data solutions.

Key Responsibilities

• Design, build, and optimize data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
• Implement and manage data storage solutions such as Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL Database.
• Develop and maintain ETL/ELT processes to ensure data quality, reliability, and accessibility.
• Collaborate with data scientists and analysts to support their data needs and facilitate advanced analytics and machine learning initiatives.
• Ensure data governance, security, and compliance across all data platforms.
• Mentor junior data engineers and contribute to best practices in data engineering.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a strong focus on Azure cloud platforms.
• Proficiency in SQL and experience with various database technologies.
• Hands-on experience with big data technologies and frameworks.
• Strong programming skills in Python or Scala.
• Excellent problem-solving and communication skills.

Preferred Qualifications

• Certifications in Azure Data Engineering (e.g., DP-203).
• Experience with real-time data streaming technologies.
• Familiarity with DevOps practices and CI/CD pipelines for data solutions.