CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Data Engineer

Datamatics Technologies

Full time On-site
Location
New Delhi, Mumbai, Bangalore, Chennai
Work mode
On-site
Posted 2 days ago Last checked 23 min ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and…
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and…
  • Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
Must-have skills
Apache SparkAzure DevOpsCI/CDDatabricksMicrosoft AzurePython
Work mode
On-site

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Location: Mumbai, India

Location: UAE-based (Travel required)

Duration: 6-month assignment

Summary (Data Engineer)

Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.

Responsibilities

  • Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
  • Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
  • Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
  • Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
  • Ensure that pipelines publish metadata and lineage to Microsoft Purview.
  • Implement scheduling, dependency management, parameterization, error handling and alerting.
  • Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
  • Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
  • Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
  • Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.

Must Have

  • 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
  • Advanced SQL, Python and PySpark/Spark skills.
  • Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
  • Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
  • Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
  • Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
  • Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
  • Excellent English communication and documentation skills.

Good to Have

  • Arabic proficiency is an advantage.

Job data: Headcount Labs (headcountlabs.com), ODbL 1.0. The job description belongs to the employer. Location data © OpenStreetMap contributors and Overture Maps.

Key skills

Required

Apache SparkAzure DevOpsCI/CDDatabricksMicrosoft AzurePythonSQL

Preferred

Data Engineering

Soft skills

Communication

Job market insights

488active Apache Spark jobs in India
5active Azure DevOps jobs in New Delhi
43active CI/CD jobs in New Delhi
7 more open jobs at Datamatics Technologies

Most IT Jobs posts in New Delhi ask for 3–6 years of experience (47% of 154 that say).

Hiring most for IT Jobs in New Delhi

  • Konrad21 open jobs
  • Bitwarden16 open jobs
  • Weekday AI9 open jobs

Jobs asking for Apache Spark in India also ask for

  • Python80%
  • SQL71%
  • Databricks53%
  • Data Engineering52%
  • AWS42%

From live job posts on CoreHRx, updated 19 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

Where is this job based?

In New Delhi, Mumbai, Bangalore, Chennai (on-site).

What kind of job is this?

It is a full time job.

This guide is for freshers in India preparing for cloud and support roles, and for developers, administrators and cloud engineers with 1 to 10 years of experience facing Microsoft Azure interviews. It has 60 questions with answers in three levels: core concepts such as regions, resource groups, Microsoft Entra ID, VMs, storage and networking; day-to-day work with Bicep, App Service, Functions, AKS, Azure SQL, KQL and Azure Policy; and senior design questions on high availability, security and cost. Read each answer, then explain it aloud in your own words and take the mock test. The questions are written by CoreHRx for practice. CoreHRx is not affiliated with or endorsed by Microsoft, and these are not actual Azure certification exam questions. Azure changes often, so check the official documentation for current details.

Questions you may be asked

  1. What is the difference between IaaS, PaaS and SaaS, with an Azure example of each?
  2. What are Azure regions, availability zones and region pairs?
  3. Explain the Azure resource hierarchy from management groups down to resources.
  4. What rules should you know about resource groups?

Get IT jobs in New Delhi by email

Create a free profile and we email you new IT jobs in New Delhi, at most once a week.

Similar jobs

Telecaller

Eduflourish
Bangalore East
Admissions CounsellingBusiness DevelopmentCommunicationTelesales
Full time On-site 9 days ago

Free · takes a minute · your resume fills your profile