Senior Software Engineer (LanceDB)
Does LanceDB sponsor H-1B visas?
Check real filing data, salaries & approval rates on VisaTalentUSA
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
AI advances at the speed of its research, and research moves at the speed of its data. LanceDB is the AI-native Multimodal Lakehouse: one system where a researcher curates petabytes of video, audio, and every signal derived from them with a few lines of Python, and the next training run starts as fast as the next idea. Customers like Runway, Midjourney, and Netflix build the future of AI on LanceDB, from frontier and world models to robots and autonomous vehicles.
We're looking for a Senior Software Engineer to help expand the reach of Lance and LanceDB within the broader data infrastructure ecosystem. You'll work at the intersection of high-performance computing, big data, and open-source systems. You will contribute scale and performance improvements, integrations with the wider data and AI ecosystem, simplifying distributed operations, and usability and maintainability enhancements.
What You'll Do
Designing and maintaining efficient distributed Lance dataset operations
Building efficient indices to enable predicate pushdown and accelerate queries in Spark, Ray, or Trino
Working on table formats, data encodings, and various aspects of the Lance format in Rust
Driving open-source community efforts to integrate the Lance format with Spark, Hive Metastore, Presto, Trino, Ray, and other data infrastructure systems
Operating and improving internal data processing infrastructure
Promoting the Lance format in open-source communities and at Big Data conferences
What We're Looking For
10+ years of experience building high-performance databases, big data systems, or large-scale data services
Deep understanding of internals of open-source Big Data or AI training systems (e.g., Hadoop, Spark, Flink, Ray, Iceberg, Delta Lake, Hudi, ClickHouse, Trino, Presto, PyTorch, or JAX)
Strong experience with high-performance computing in C++, Java, and/or Scala
Experience with Rust (or willingness to learn it)
Proven ability to move fast, work independently, and collaborate with a high-caliber team
Nice to Have
Contributor, committer, or PMC member in Apache or other large open-source projects
Experience with Apache Arrow, DataFusion, Parquet, Iceberg, or Delta Lake
Track record of driving large features or integrations in distributed systems
Strong community presence and passion for open-source collaboration
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
More Openings at LanceDB
Explore Top Companies in this Space
EnterpriseDB
Enterprise Software / Database Management / AI / Cloud Computing
PingCAP
Enterprise software / Distributed Computing / Database Technology / AI Infrastructure
Pinecone
Database Software / Vector Database / Generative AI Infrastructure / Cloud Data
SingleStore
Database Tech / Enterprise Software / AI Infrastructure
LanceDB
View Company ProfileLanceDB (operating at lancedb.com) is a multimodal lakehouse platform engineered for AI, accelerating large-scale data curation and feature engineering to help teams build better models faster. Headquartered in San Francisco, California, LanceDB provides a developer-friendly, open-source vector database that can be run locally or on a custom server, offering lightning-fast, scalable, and production-ready vector search capabilities. Under the hood, it unifies AI data in an open format, enabling seamless integration of text, images, and other modalities within a single infrastructure. This allows developers and data teams to streamline AI/ML workflows, from data ingestion to model training, without the complexity of managing disparate systems. The company has raised funding, including a Series A round, to further develop its multimodal lakehouse vision.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.