CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Databricks Data Engineer (Unity Catalog, Lakeflow, PySpark)

Digital Links Inc

Full time Remote
Experience
6+ years
Location
Mumbai
Work mode
Remote
Salary
₹11L – ₹27L a year estimatetypical for IT Jobs in Maharashtra, 109 posts
Posted Today

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Design, develop and maintain Databricks Jobs and Lakeflow pipelines: ingestion, silver layer transformation, feature engineering, model…
  • Implement and manage Unity Catalog - schemas, tables, volumes, lineage and access grants - as the single governance layer
  • Build and optimise Databricks SQL warehouses for Genie Spaces, dashboards and ad-hoc performance queries
Experience
6+ years
Must-have skills
AgileApache SparkCI/CDDatabricksELTGit
Work mode
Remote

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Databricks Data Engineer (Unity Catalog, Lakeflow, PySpark)

Location: India - 100% Remote
Engagement: Contract
Experience: 6+ years

About the Role

We are seeking an experienced Databricks Data Engineer to design, build and maintain scalable data pipelines and governed data solutions on the Databricks Lakehouse platform - hands-on with Databricks Jobs and Lakeflow pipelines, Unity Catalog, SQL warehouses and enterprise data security - delivering production-grade pipelines for demand forecasting and retail performance intelligence.

Key Responsibilities
  • Design, develop and maintain Databricks Jobs and Lakeflow pipelines: ingestion, silver layer transformation, feature engineering, model training and forward projection
  • Implement and manage Unity Catalog - schemas, tables, volumes, lineage and access grants - as the single governance layer
  • Build and optimise Databricks SQL warehouses for Genie Spaces, dashboards and ad-hoc performance queries
  • Enforce security with Unity Catalog RBAC - column-level, row-level and workspace-level permissions
  • Develop the silver layer - ingestion from SQL Server and data quality checks
  • Build feature engineering notebooks: weekly demand aggregation, SKU attributes, demand calendar, store traffic and horizon training features
  • Work with ML engineers on model pipeline integrity (eval metrics, routing correctness, production refits with recent data)
  • Monitor pipeline health, validate data quality gates and support stakeholder validation milestones
  • Maintain notebook/pipeline documentation, Git version control and reproducible run configurations
Required Skills & Qualifications
  • Strong hands-on Databricks - Jobs, Lakeflow (Delta Live Tables), notebooks, clusters, SQL warehouses
  • PySpark and Databricks SQL - complex transformations, window functions, aggregations, performance tuning
  • Deep Unity Catalog experience - three-level namespace, access control, lineage, cross-workspace governance
  • Databricks security model - workspace access, cluster policies, secrets, row/column-level security
  • ELT pipelines from SQL Server and other relational sources into Delta tables (bronze, silver, gold)
  • Delta Lake - ACID, merge patterns, schema evolution, time travel
  • Strong debugging and data quality skills
  • Git, CI/CD for notebooks and pipelines, Agile delivery
  • Excellent communication with technical and business stakeholders
Preferred (Good to Have)
  • Databricks Genie Spaces / natural language query interfaces
  • Retail demand forecasting pipelines
  • Databricks Certified Data Engineer Associate or Professional
  • Power BI with Databricks SQL warehouses
  • SQL Server ingestion (pyodbc, JDBC) and incremental loads
  • Data quality frameworks - expectations, row counts, freshness checks
Education

Bachelor's degree

Key skills

Required

AgileApache SparkCI/CDDatabricksELTGitMicrosoft SQL ServerSQL

Preferred

Power BI

Soft skills

Communication

Job market insights

126active Agile jobs in Mumbai
14active Apache Spark jobs in Mumbai
101active CI/CD jobs in Mumbai
₹11L – ₹27L advertised yearly salary for IT Jobs in Maharashtra (middle half of 109 posts that show a salary; median ₹19L)
8 more open jobs at Digital Links Inc

Most IT Jobs posts in Mumbai ask for 3–6 years of experience (47% of 529 that say).

Hiring most for IT Jobs in Mumbai

  • JPMorgan Chase71 open jobs
  • Necsws24 open jobs
  • Schneider Electric24 open jobs

Jobs asking for Agile in Mumbai also ask for

  • CI/CD35%
  • Java33%
  • Project Management23%
  • Python22%
  • SQL21%

From live job posts on CoreHRx, updated 11 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

What is the salary for this Databricks Data Engineer (Unity Catalog, Lakeflow, PySpark) job?

The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹11L – ₹27L a year (typical for IT Jobs in Maharashtra, 109 posts).

How much experience does this job need?

The post asks for 6 Yrs experience.

Where is this job based?

It is a remote job, listed under Mumbai.

What kind of job is this?

It is a full time job.

This guide is for Indian job seekers preparing for SQL rounds in data analyst, data engineer, backend developer and database roles, from freshers to experienced professionals. It has 60 questions in three levels: easy covers joins, grouping and NULLs; medium covers window functions, CTEs, indexes and isolation levels; hard covers locking, MVCC, query tuning and classic puzzles such as login streaks and medians. Answers use ANSI SQL, with MySQL 8 and PostgreSQL notes where the two differ. Write each query against your own sample tables first, then compare your result with the sample answer.

Questions you may be asked

  1. What is the difference between WHERE and HAVING?
  2. What is the difference between DELETE, TRUNCATE and DROP?
  3. What is the difference between an INNER JOIN and a LEFT JOIN?
  4. What is the difference between a primary key and a unique key?

Get IT jobs you can do remotely by email

Create a free profile and we email you new IT jobs you can do remotely, at most once a week.

Similar jobs

Free · takes a minute · your resume fills your profile