Back to Jobs
Weekday
Data Science & Analytics 4h ago

Resident Solutions Architect (Databricks, Apache Spark, Data Engineering)

weekday
IndiaIndia
Full-time
Not Disclosed
Senior-Level

Job Description

Key Skills Required

Master these to land this role

SQL15 minFree Trial ✨
Start 10-Day Free Trial
AWS/Azure/GCPData EngineeringApache SparkDatabricksLakehouse / Data Warehouse / Big Data architecture

Want to know if you're a match for this job?

Calculate My Match Score

The ideal candidate combines strong hands-on technical expertise with excellent customer-facing, consulting, and communication skills.

Key Responsibilities

  • Work directly with enterprise customers as a trusted technical advisor.
  • Understand customer business and technical requirements and translate them into scalable data architectures.
  • Design and implement modern Lakehouse / Data + AI architectures using Databricks.
  • Develop and guide proof-of-concepts (POCs), technical workshops, and architecture demonstrations.
  • Work extensively with Apache Spark / PySpark, SQL, and Databricks.
  • Design scalable data ingestion, transformation, and processing pipelines.
  • Work with Delta Lake, Unity Catalog, and Databricks platform capabilities.
  • Support data migration and modernization initiatives.
  • Integrate Databricks with cloud platforms such as AWS, Azure, or GCP.
  • Troubleshoot performance, scalability, reliability, and data pipeline issues.
  • Collaborate with customer engineering, data science, architecture, and leadership teams.
  • Provide technical recommendations around data engineering, analytics, ML/AI, and cloud architecture.
  • Create reference architectures, technical documentation, and implementation guidance.
  • Support production deployment and adoption of Databricks solutions.
  • Conduct technical workshops, enablement sessions, and knowledge-sharing activities.

Required Skills

Must Have

  • Strong experience with Databricks
  • Strong Apache Spark / PySpark
  • Strong SQL
  • Strong Data Engineering fundamentals
  • Experience designing data pipelines / data platforms
  • Experience with Lakehouse / Data Warehouse / Big Data architecture
  • Experience with at least one cloud: AWS, Azure, or GCP
  • Strong customer-facing / consulting experience
  • Architecture/design experience
  • Excellent communication and presentation skills

Good to Have

  • Delta Lake
  • Unity Catalog
  • MLflow
  • Kafka
  • Streaming
  • Data migration
  • MLOps
  • Machine Learning
  • GenAI
  • Data governance
  • Terraform / CI/CD
  • Snowflake
  • Hadoop ecosystem

How would you rate this job post?

See what other professionals think about this role.

banner

Weekday is an AI-powered recruitment platform designed to act as a fully automated outbound sourcing engine. Instead of posting a job on traditional boards and waiting for active job seekers to apply, Weekday empowers companies to proactively hunt top-tier tech talent. They maintain a massive database of over 250 million profiles (heavily focused on the US and India) complete with verified contact data. Their AI contextually screens candidates to find the perfect fit, and then the platform automatically runs personalized, multi-channel outreach campaigns to engage those passive engineers and bring them directly into your interview pipeline.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More
Resident Solutions Architect (Databricks, Apache Spark, Data Engineering) at Weekday | HireSkys