Senior Data Platform Engineer

We are looking for a Senior Data Platform Engineer to design, build, and operate secure, scalable, and reliable data platform capabilities across client delivery projects in the public sector and utilities.

You will work closely with Data Engineers, Software Engineers, Architects, DevOps Engineers, and client stakeholders to develop and maintain cloud-native data platforms supporting batch, real-time streaming, analytical, and operational workloads.

This is a hands-on engineering role focused on building reliable platform services, automating infrastructure and deployments, supporting production environments, and contributing to technical design decisions.

Strong experience with cloud platforms, distributed systems, and real-time streaming technologies is highly desirable.

Key Responsibilities

• Design, develop, test, and deploy data platform services and components.
• Build and maintain platform capabilities supporting batch and real-time data workloads.
• Develop and operate distributed data services using Kafka, Kinesis, Spark, Flink, or equivalent technologies.
• Build and maintain cloud-native data platform capabilities using AWS and/or Azure.
• Support data ingestion, processing, storage, and integration across multiple systems.
• Develop and maintain data models, schemas, and platform data structures.
• Support schema evolution, data quality, and data integrity across distributed platforms.
• Integrate data platforms with relational and NoSQL databases.
• Develop automated testing and validation for platform services and data processing components.
• Implement and maintain CI/CD pipelines for data platform workloads.
• Use Infrastructure as Code to create repeatable and maintainable environments.
• Support Docker and Kubernetes-based platform environments.
• Monitor platform services and investigate failures, performance issues, and operational problems.
• Participate in incident investigation and root cause analysis.
• Support platform performance, scalability, resilience, and availability improvements.
• Contribute to platform security, governance, and operational readiness.
• Work closely with Software Engineers, Data Engineers, DevOps, and Architects.
• Participate in technical design discussions, code reviews, and engineering standards.
• Contribute to continuous improvement of platform engineering practices.

Essential Technical Skills & Experience

• Strong commercial experience as a Senior Data Platform Engineer, Senior Data Engineer, Platform Engineer, Software Engineer, or similar.
• Strong hands-on experience building and operating cloud-native data platforms.
• Strong programming experience using Java and/or Python.
• Hands-on experience with real-time streaming and event-driven architectures, including Kafka, Kinesis, or equivalent.
• Experience with distributed data processing technologies such as Spark, Flink, Kafka Streams, or equivalent.
• Strong experience with AWS and/or Azure cloud environments.
• Experience with cloud services such as S3, Glue, Lambda, RDS, Athena, EC2 or Azure equivalents.
• Strong understanding of data platform architecture, data pipelines, and distributed processing.
• Experience with relational and NoSQL databases.
• Strong SQL skills and understanding of data modeling and schema design.
• Experience with CI/CD and DevOps practices.
• Experience using Terraform or equivalent Infrastructure as Code technologies.
• Experience with Docker and/or Kubernetes.
• Experience using GitHub/GitLab and modern source control practices.
• Experience implementing monitoring, logging, and observability for platform services.
• Experience supporting production systems and resolving technical and operational issues.
• Understanding of platform security, resilience, scalability, and availability.
• Experience working within Agile and/or DevOps delivery environments.
• Desirable: Helm, ArgoCD, Airflow, dbt, Bash, Ansible, Packer, Elasticsearch/OpenSearch, Prometheus, Grafana, ELK, or Datadog.
• Experience working within public sector, utilities, or other regulated environments is advantageous.

Data Platform Engineering

As a Senior Data Platform Engineer, you will take ownership of complex platform engineering activities within your client delivery team.

• Build and maintain reliable data platform components and services.
• Contribute to technical design and implementation decisions.
• Develop reusable and maintainable platform patterns.
• Support data ingestion, processing, storage, and integration capabilities.
• Identify platform risks relating to performance, scalability, security, and reliability.
• Contribute to platform performance tuning and optimization.
• Participate in code reviews and promote clean, maintainable engineering practices.
• Support production troubleshooting and root cause analysis.
• Share knowledge and support less experienced engineers.
• Contribute to improving platform automation, reliability, and engineering standards.

Cloud, Infrastructure & Automation

You will work across modern cloud and infrastructure technologies, including:

• AWS and/or Azure cloud services.
• Infrastructure as Code using Terraform or equivalent.
• Docker and Kubernetes containerized environments.
• CI/CD using GitHub Actions, GitLab CI, Jenkins, or equivalent.
• Automated provisioning and configuration.
• Monitoring, logging, alerting, and observability.
• Platform security and access controls.
• Resilience, backup, and disaster recovery considerations.

Experience & Qualifications

You should have 5+ years of relevant professional experience across Data Engineering, Data Platform Engineering, Software Engineering, Platform Engineering, or a similar technical discipline.

For a Senior-level appointment, you should demonstrate strong hands-on technical capability, ownership of complex platform engineering activities, and the ability to work independently within client delivery environments.

About You

You are a hands-on Data Platform Engineer who enjoys building and operating the infrastructure and services that make modern data platforms work reliably in production.

You are comfortable working across cloud platforms, streaming, distributed systems, data processing, Infrastructure as Code, and containerization.

You understand that effective data platforms need to be secure, scalable, observable, resilient, and maintainable, not simply capable of processing data.

You take ownership of your work, enjoy solving complex technical problems, and work well with engineers across different disciplines.

You are pragmatic, technically curious, and focused on delivering reliable platform capabilities that create measurable value for clients.

Experience working within public sector, utilities, or other complex and regulated environments would be highly advantageous.