Senior Database Integration Engineer (ClickPipes - Database Integrations)
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
About the Team
The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.
As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB, an open-source CDC platform we actively maintain and contribute to.
See some of our recent work:
- ClickPipes for Postgres now supports failover replication slots
- MongoDB CDC to ClickHouse with Native JSON Support
- Under the Hood: Building MySQL Change Data Capture in ClickPipes
What You’ll Do:
Build data-intensive systems
- Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
- Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.
- Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.
Own end-to-end reliability
- Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).
- Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
- Write clear documentation, both publicly and internally.
- Participate in on-call rotation.
Drive product innovation
- Work directly with customers to understand integration requirements and discover gaps in existing product.
- Collaborate cross-functionally with internal teams to ensure operational efficiency.
- Lead technical discussions and influence product roadmaps.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
More Openings at Clickhouse
Explore Top Companies in this Space
PlanetScale
Database Technology
Couchbase
Enterprise Software / Database Technology / Cloud Computing
Ditto
Information Technology / Edge Computing / Database Software
Muttdata
IT Services / IT Consulting / Machine Learning / Enterprise Software
Clickhouse
View Company ProfileClickHouse is a pioneering technology company that specializes in developing and maintaining an open-source, column-store database management system. Designed to handle large volumes of data, the ClickHouse database is optimized for real-time analytics and is capable of processing billions of rows per second. With its roots in Yandex, one of Europe's largest internet companies, ClickHouse has evolved to become a standalone entity, committed to pushing the boundaries of data processing and analysis. The company's core product, also named ClickHouse, has been widely adopted across various industries, including fintech, e-commerce, and cybersecurity, due to its exceptional performance, scalability, and ease of use. By providing a robust and flexible solution for data-driven businesses, ClickHouse is empowering organizations to make data-informed decisions, enhance operational efficiency, and drive innovation. With a strong focus on community engagement and continuous improvement, ClickHouse is poised to remain at the forefront of the database technology landscape.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.