Back to Jobs
RevStar Consulting
AI & Machine Learning 1h ago

Data & AI Engineer (Databricks Specialist)

RevStar Consulting
United StatesUnited States
Full-time
Not Disclosed
Mid-Level

Job Description

Key Skills Required

Master these to land this role

Python2h 41mFree Trial ✨
Start 10-Day Free Trial
SQL15 minFree Trial ✨
Start 10-Day Free Trial
Infrastructure-as-CodeApache SparkMLOpsDatabricksMLflowDelta LakeCloud-Native Data Engineering

Want to know if you're a match for this job?

Calculate My Match Score

Ready to build greenfield Lakehouse solutions at the bleeding edge of AI and big data? RevStar is an innovation shop and official Databricks Partner launching a dedicated, cloud-agnostic Data, ML, and AI practice.

Tired of spending months in endless corporate approval loops only to build AI concepts that never reach production? We turn modern Lakehouse architectures and production AI into live, scalable enterprise solutions in fast-paced execution cycles. We build fast, cut bureaucratic red tape, and ship production-ready solutions for client founders and tech leaders who value real engineering impact.

In this role, you will work directly with data architects, scientists, and client leaders to turn complex data into scalable, production-ready AI models. Above all, our team operates on three core principles:

  • Self-Mastery: We hold a high bar for how we think, communicate, and improve.
  • Ownership: We own outcomes, not just effort.
  • Shared Destiny: We rise or fall together.

Your Impact Pillars

1. Databricks Lakehouse & Pipeline Engineering: Design, build, and optimize scalable ETL/ELT pipelines using Apache Spark and Delta Lake across multi-cloud environments (AWS, Azure, GCP). Implement robust Lakehouse architectures that seamlessly process both structured and unstructured data at enterprise scale. Automate data ingestion, storage, and feature engineering workflows to support downstream analytics and real-time AI workloads.

2. Performance Tuning & MLOps Integration: Fine-tune Spark jobs for low latency, high throughput, and maximum cloud cost-efficiency across client environments. Partner with ML engineers and data scientists to operationalize AI models inside Databricks using MLflow for tracking, versioning, and deployment. Implement robust CI/CD pipelines and Infrastructure-as-Code (Terraform, Databricks CLI) to establish automated, production-grade deployments.

3. Data Governance & Client Leadership: Enforce enterprise data security, access controls, and compliance standards (GDPR, HIPAA, SOC 2) within Unity Catalog and cloud ecosystems. Collaborate directly with client tech leaders, product managers, and engineering teams to translate complex AI data requirements into clear business outcomes. Author clean technical documentation and lead seamless solution handoffs to client engineering teams upon project completion.

Requirements

What You Bring

  • Core Experience: 3+ years in cloud-native data engineering with 2+ years of dedicated, hands-on Databricks, Apache Spark, Delta Lake, and MLflow experience.
  • Technical Mastery: High proficiency in Python, SQL, Spark frameworks, CI/CD, and Infrastructure-as-Code (Terraform or Databricks CLI).
  • Strong Differentiator: Active Databricks Certified Data Engineer (Associate or Professional) or Databricks ML Professional certification is strongly preferred and will set your application apart.
  • Consulting Mindset: Proven track record operating in fast-paced Agile/DevOps consulting environments, delivering cloud-agnostic architectures with exceptional client communication.

How would you rate this job post?

See what other professionals think about this role.

banner
logo

RevStar Consulting

View Company Profile

RevStar Consulting (operating under revstarconsulting.com, legally RevStar Inc.) is the premier, enterprise-grade digital transformation firm, cloud-native software engineering pioneer, and generative AI orchestration powerhouse engineered to serve as the definitive, high-velocity application modernization, data engineering, and agile product development layer for business leaders navigating high-stakes industry changes. Founded by technology visionary Ken Pomella, the firm completely eliminates the severe systemic friction of modern corporate innovation—where legacy systems, fragmented internal data silos, and slow development pipelines cause organizations to lose market momentum, drain capital on unoptimized infrastructure, and stall critical digital growth—by deploying an advanced \"Innovation + Execution\" co-creation matrix. Moving far beyond traditional, passive technology agencies or rigid IT staffing operations, RevStar natively unifies rapid MVP development sprints, comprehensive application modernization on AWS (including validated expertise in ECS, Fargate, and serverless Lambda systems), custom Databricks data lake foundations, and production-ready generative AI integrations leveraging Amazon Bedrock and Claude frameworks into a single high-availability digital consulting workspace. Serving mid-market innovators and enterprise giants across highly regulated sectors including healthcare, insurance, and fintech, the firm's production-hardened engineering teams slash operational friction—such as automating unstructured claims parsing to reduce manual processing windows by 99%—with strict system precision. Strategically configured as a 100% remote-first powerhouse with its primary corporate hub in Tampa, Florida, the organization spans a deeply talented global developer footprint across North America and South America. Under the hood, its operational engine utilizes rapid prototyping workshops, robust automated LLMOps pipelines, and secure role-based access architectures designed to accelerate client feature delivery and unlock the true commercial value of corporate datasets without reducing daily operational velocity. What sets RevStar apart is its uncompromising dedication to replacing slow, theoretical advisory frameworks with absolute project velocity, rapid cloud scalability, and business-first impact clarity; by bridging the gap between performance-intensive low-level technical infrastructure and real-world executive vision, the firm remains a definitive cornerstone of modern algorithmic digital transformation and global cloud engineering.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More