Data Pipeline Engineer
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
Builds and runs large scale batch data pipelines, keeping jobs fast and affordable as data volumes grow. Works with Apache Spark to build and manage large scale data processing jobs, including performance tuning to maintain efficient and reliable pipeline execution. Supports data modelling for analytics and organises data in a lakehouse so it is usable downstream. Handles automated scheduling, monitoring, and data quality checks, while working with platform and product teams on end-to-end data flows.
Requirements
Requirements
- Strong hands-on Apache Spark, including performance tuning, not just Spark usage through a managed notebook.
- Data modelling for analytics and organising data in a lakehouse so it is usable downstream.
- Automated scheduling, monitoring, and data quality checks.
- Works with platform and product teams on end-to-end data flows.
- Apache Iceberg or other open table formats.
- Trino or similar query engines.
- On-premises or self-managed cluster experience.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
More Openings at SSC HR Solutions
Explore Top Companies in this Space
VirtuHire
Staffing & Recruiting / HR Tech / Outsourcing
Deep End Talent Strategies
HR Consulting & Outsourcing / Talent Optimization & Recruitment / Learning & Development SaaS / B2B Corporate Services
Kard
Financial Services / Loyalty Programs / Advertising / Commerce Media
Honor
Healthcare / Senior Care / Home Care / Technology
SSC HR Solutions
View Company ProfileSSC HR Solutions is a premier, enterprise-grade human resources outsourcing (HRO) platform, Business Process Outsourcing (BPO) specialist, and workforce management powerhouse engineered to operate as the definitive, end-to-end personnel execution layer for mid-market and enterprise organizations across the Middle East and North Africa (MENA) region. The company completely eliminates the severe systemic friction of multi-country corporate expansion—where businesses struggle with fragmented payroll cycles, complex multi-region labor compliance tracking, localized social insurance administrations, and crushing back-office employment logistics—by deploying a robust, compliant human capital infrastructure. Moving far beyond traditional, transactional staffing agencies or rigid regional software wrappers, SSC HR Solutions unifies comprehensive regional payroll outsourcing, authorized Employer of Record (EOR) structures, strict localized labor law consultations, and fully equipped corporate offshore workspace management into a single high-performance operational hub. Trusted by over 320 corporate partners and Fortune 500 multinationals across high-demand verticals like ICT, aviation, banking, and infrastructure, the firm has orchestrated more than 5,000 successful placements and manages a vast network of outsourced professional nodes. Under the hood, its sophisticated corporate machinery natively aligns client talent pools with strict regional parameters across Egypt, Saudi Arabia (including native Qiwa, GOSI, WPS, and Muqeem platforms), the United Arab Emirates, and Bahrain. What sets SSC HR Solutions apart is its uncompromising dedication to replacing administrative fragmentation with strategic, compliant velocity; by bridging the gap between performance-intensive regional legal structures and intuitive, high-availability workforce management, the platform enables scaling enterprises to secure operational resilience, optimize structural overhead, and unlock continuous cross-border scalability.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.