Streaming Pipeline Engineer
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
Builds and runs real-time streaming pipelines, ensuring low latency and job recoverability at high volume.
- Strong hands-on experience with Apache Flink across the DataStream API and Flink SQL.
- Manages event time processing, checkpointing, savepoints, and state management in production environments.
- Handles high-volume Kafka streaming.
- Develops data models for analytics and streaming into a lakehouse.
- Monitors pipeline health and manages recovery when jobs fail.
The Role
Responsibilities include designing, implementing, and maintaining scalable streaming architectures to process real-time data efficiently.
Requirements
Key technical requirements include:
- Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
- Experience with high-volume Kafka streaming and real-time data processing.
- Proficiency in event time processing, checkpointing, savepoints, and state management.
- Experience with data modeling for analytics and streaming into a lakehouse.
- Experience monitoring pipeline health and handling job recovery and failures.
- Familiarity with Apache Iceberg or other open table formats.
- Experience with Apache Airflow.
- Experience with on-premises or self-managed clusters.
- Proficiency in Java, Scala, Python, SQL, Docker, and Kubernetes.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
Senior Telecom Data Architect – BSS/OSS & Customer Data
SSC HR Solutions
EgyptSenior Data Architect (Banking)
SSC HR Solutions
EgyptSenior CVM & Marketing Analytics Professional (Telco)
SSC HR Solutions
EgyptCommercial Operations Analyst (Technical Data & Documentation / Market & Competitive Intelligence)
SSC HR Solutions
EgyptMore Openings at SSC HR Solutions
Explore Top Companies in this Space
Deep End Talent Strategies
HR Consulting & Outsourcing / Talent Optimization & Recruitment / Learning & Development SaaS / B2B Corporate Services
VirtuHire
Staffing & Recruiting / HR Tech / Outsourcing
Submittable
Enterprise Software / Grant Management / Corporate Social Responsibility / SaaS
Foley Hoag LLP
Legal Services / Corporate Law / Litigation / Venture Capital
SSC HR Solutions
View Company ProfileSSC HR Solutions is a premier, enterprise-grade human resources outsourcing (HRO) platform, Business Process Outsourcing (BPO) specialist, and workforce management powerhouse engineered to operate as the definitive, end-to-end personnel execution layer for mid-market and enterprise organizations across the Middle East and North Africa (MENA) region. The company completely eliminates the severe systemic friction of multi-country corporate expansion—where businesses struggle with fragmented payroll cycles, complex multi-region labor compliance tracking, localized social insurance administrations, and crushing back-office employment logistics—by deploying a robust, compliant human capital infrastructure. Moving far beyond traditional, transactional staffing agencies or rigid regional software wrappers, SSC HR Solutions unifies comprehensive regional payroll outsourcing, authorized Employer of Record (EOR) structures, strict localized labor law consultations, and fully equipped corporate offshore workspace management into a single high-performance operational hub. Trusted by over 320 corporate partners and Fortune 500 multinationals across high-demand verticals like ICT, aviation, banking, and infrastructure, the firm has orchestrated more than 5,000 successful placements and manages a vast network of outsourced professional nodes. Under the hood, its sophisticated corporate machinery natively aligns client talent pools with strict regional parameters across Egypt, Saudi Arabia (including native Qiwa, GOSI, WPS, and Muqeem platforms), the United Arab Emirates, and Bahrain. What sets SSC HR Solutions apart is its uncompromising dedication to replacing administrative fragmentation with strategic, compliant velocity; by bridging the gap between performance-intensive regional legal structures and intuitive, high-availability workforce management, the platform enables scaling enterprises to secure operational resilience, optimize structural overhead, and unlock continuous cross-border scalability.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.