CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Senior Data Engineer - ETL Frameworks

Emirates Islamic Bank

Full time
Experience
8+ years
Location
India
Work mode
Not stated
Posted 5 hr ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Ability to design, develop and maintain high performant data pipelines
  • Good understanding of source systems data structures, data retentions policies and data partitioning for modeling raw data vault structures
  • Deep understanding of PySpark
Experience
8+ years
Education
Bachelor's degree
Must-have skills
Apache SparkData EngineeringData GovernanceHadoopData QualitySQL

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Description

The Senior Data Engineer works closely with other Data Leads, Delivery Leads and Chapter head and help drive the Data Management and Analytics vision and strategy to deliver common, secure and consistent data capabilities across the EmiratesNBD Group. This role will involve strategic initiatives and reports into Head of Data Engineering Chapter and will manage the Data engineering, architecture and design of related approaches, tools and technologies.

The primary task is to drive and transform the data capabilities and enable a data-driven culture across the group and therefore work with other architects and platform teams to ensure data is managed as an asset in a centralized, standardized, and consistent manner in order to maintain consistency and quality, using mature technologies and emerging data practices.

This role requires an understanding of various data engineering, management and processing related technologies and choices, has a deep understanding of both SQL/No-SQL technologies, distributed computing framework, and techniques to make right tools and technology choices.

#LI-SA1



Responsibilities
  • Ability to design, develop and maintain high performant data pipelines
  • Good understanding of source systems data structures, data retentions policies and data partitioning for modeling raw data vault structures
  • Deep understanding of PySpark
  • Perform deep performance tuning including:
    Spark execution plan analysis
    Partition optimization
    Memory tuning
    Shuffle optimization
    Join strategy optimization
    Data skew handling
    Executor tuning
    Serialization optimization
  • Drive data reusability, reduce duplicity of data, minimizing adverse impact to performance
  • Cloudera Data Platform (CDP)
  • Hadoop ecosystem
  • Apache Iceberg
  • Apache Doris
  • Kubernetes/OpenShift
  • Alignment of data and information architecture with business objectives and priorities
  • Participate in architecture discussions and contribute to enterprise-scale data engineering standards
  • Outline short-term incremental solutions to achieve long-term objectives and an overall data management roadmap
  • Create data exchange standards to ensure reusability and a decoupled architecture
  • Create standards for data archival and purging
  • Drive best practices around performance engineering, CI/CD, testing, and operational excellence
  • Develop data access matrix and ensure right information reaches the right people through secured channels
  • Develop strategy to align with external regulatory requirements
  • Identify and document critical data elements across source system of records
  • Define and document the data quality rules and standards
  • Assess and define data governance and stewardship maturity roadmap
  • Work with data engineers and source system experts to define the standards and principles for capturing lineage and data flow
  • Define data exception handling processes
  • Define standards for data pipeline scheduling and monitoring
  • Provide technical recommendations and engage with data engineers and BI leads throughout the solutioning and implementation lifecycle
  • Recommend effective solutions to develop high performant and scalable data pipelines
  • Work with source system expertise to understand the data domains and source to target mapping
  • Build and maintain canonical datamodel to standardize data exchange between systems and with various architects to enforce the same

    #LI-SA1


Qualifications
  • Master or Bachelor’s degree in computer science, information systems management or related field
  • More than 8+ years of experience in information technology, with 3+ years spent in data engineering, architecture and technology solutions definitions and implementations
  • Extensive experience in banking and financial services domain
    Strong problem solving, influencing, communication, and presentation skills, self-starter
  • Strong hands-on expertise in programming on PySpark
  • Experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.)
  • Exposure to designing and developing reusable frameworks for enabling scalable and performant data pipelines
  • Experiences in cloud native principals, designs and deployments.
  • Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments
  • Expertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival
  • Define workload migration strategies using appropriate tools
  • Drive delivery in a matrixed environment working with various internal IT partners
  • Demonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously
  • Must be able to work independently and have skills in planning, strategy, estimation, scheduling,

#LI-SA1



Key skills

Required

Apache SparkData EngineeringData GovernanceHadoopData QualitySQL

Soft skills

CommunicationPresentation SkillsProblem Solving

Job market insights

489active Apache Spark jobs in India
997active Data Engineering jobs in India
718active Data Governance jobs in India
1 more open job at Emirates Islamic Bank

Jobs asking for Apache Spark in India also ask for

  • Python81%
  • SQL71%
  • Databricks53%
  • Data Engineering52%
  • AWS42%

From live job posts on CoreHRx, updated 19 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

How much experience does this job need?

The post asks for 8 Yrs experience.

What kind of job is this?

It is a full time job.

This guide is for Indian job seekers preparing for SQL rounds in data analyst, data engineer, backend developer and database roles, from freshers to experienced professionals. It has 60 questions in three levels: easy covers joins, grouping and NULLs; medium covers window functions, CTEs, indexes and isolation levels; hard covers locking, MVCC, query tuning and classic puzzles such as login streaks and medians. Answers use ANSI SQL, with MySQL 8 and PostgreSQL notes where the two differ. Write each query against your own sample tables first, then compare your result with the sample answer.

Questions you may be asked

  1. What is the difference between WHERE and HAVING?
  2. What is the difference between DELETE, TRUNCATE and DROP?
  3. What is the difference between an INNER JOIN and a LEFT JOIN?
  4. What is the difference between a primary key and a unique key?

Get IT jobs by email

Create a free profile and we email you new IT jobs, at most once a week.

Similar jobs

Free · takes a minute · your resume fills your profile