CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Senior Data Engineer

ADM

Full time
Location
Bangalore
Work mode
Not stated
Salary
₹14L – ₹26L a year estimatetypical for IT Jobs in Bangalore, 234 posts
Posted 13 days ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Python and Spark Programming: Develop and maintain scalable data pipelines using Apache Spark within Azure Databricks/ Python/ Pyspark.
  • Write optimized, high-performance Spark jobs to process large volumes of data efficiently.
  • Utilize PySpark for distributed data processing, transformation, and aggregation tasks.
Must-have skills
DatabricksMachine LearningData WarehousingPython

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Job Description
Job Title: Senior Data Engineer
Overview:
We are seeking a skilled and motivated Azure Databricks Data Engineer to join our dynamic team. The ideal candidate will have strong experience with Python, Spark programming, and expertise in building and optimizing data pipelines in Azure Databricks. You will play a pivotal role in leveraging Databricks workflows, Databricks Asset Bundles, and CI/CD pipelines using GitHub to deliver high-performance data solutions. A solid understanding of Data Warehousing and Data Mart architecture in Databricks is critical for success in this role. If youre passionate about data engineering, cloud technologies, and scalable data architecture, wed love to hear from you!
Key Responsibilities:
Python and Spark Programming: Develop and maintain scalable data pipelines using Apache Spark within Azure Databricks/ Python/ Pyspark. Write optimized, high-performance Spark jobs to process large volumes of data efficiently. Utilize PySpark for distributed data processing, transformation, and aggregation tasks.
Databricks Workflows: Design and implement Databricks Workflows to automate data pipeline execution, orchestrating complex workflows and batch jobs. Set up task dependencies, triggers, and notifications to ensure smooth and reliable execution. Monitor, troubleshoot, and optimize Databricks workflows for optimal performance and minimal failures.
Databricks Asset Bundles: Create and manage reusable components such as Databricks Asset Bundles, including notebooks, libraries, and models. Share and reuse asset bundles across teams to increase efficiency and ensure consistency in development.
CI/CD for Databricks Artifacts using GitHub: Implement CI/CD pipelines using GitHub Actions for the continuous integration and deployment of Databricks notebooks, jobs, and libraries. Automate the testing, building, and deployment processes to ensure smooth, consistent code delivery across environments. Collaborate with teams to implement version control practices and code reviews using GitHub.
Data Warehousing & Data Mart Design: Design and implement Data Warehousing and Data Mart solutions using Databricks, ensuring high-performance storage and retrieval of structured data. Integrate data from multiple sources into a central data warehouse using Spark-based transformations, ensuring efficient schema design and query performance. Implement dimensional modeling, including star and snowflake schemas, within Azure Databricks for data marts to support business intelligence and reporting. Data Pipeline Optimization and Management: Continuously monitor and optimize Databricks-based data pipelines for performance, scalability, and cost efficiency. Implement best practices for data partitioning, caching, and query optimization within the Databricks platform. Troubleshoot and resolve issues related to data integrity, performance, and workflow execution.
Collaboration and Stakeholder Communication: Work closely with data scientists, analysts, and other teams to understand requirements and build data solutions that meet business needs. Communicate technical concepts effectively to both technical and non-technical stakeholders. Provide mentorship and guidance to junior data engineers on Databricks best practices, data architecture, and efficient coding techniques.
Preferred Qualifications:
Cloud Certifications: Azure certifications, particularly in Databricks, Data Engineering, or Cloud Solutions, are a plus. Big Data Technologies: Familiarity with other big data tools such as Kafka, Hadoop, or Flink for streaming and real-time data processing is a plus.
Data Science/ML Experience: Exposure to machine learning workflows and model management within Databricks (e.g., using MLflow) is beneficial.

Key skills

Required

DatabricksMachine LearningData WarehousingPython

Preferred

Data EngineeringHadoopKafkaMicrosoft Azure

Job market insights

312active Databricks jobs in Bangalore
503active Machine Learning jobs in Bangalore
116active Data Warehousing jobs in Bangalore
₹14L – ₹26L advertised yearly salary for IT Jobs in Bangalore (middle half of 234 posts that show a salary; median ₹19L)
4 more open jobs at ADM

Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 4742 that say).

Hiring most for IT Jobs in Bangalore

  • Bosch Group176 open jobs
  • Brillio120 open jobs
  • Eurofins116 open jobs

Jobs asking for Databricks in Bangalore also ask for

  • Python63%
  • SQL57%
  • Microsoft Azure52%
  • AWS37%
  • Data Engineering36%

From live job posts on CoreHRx, updated 16 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

What is the salary for this Senior Data Engineer job?

The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹14L – ₹26L a year (typical for IT Jobs in Bangalore, 234 posts).

Where is this job based?

In Bangalore.

What kind of job is this?

It is a full time job.

This guide is for freshers in India preparing for their first data science or machine learning interview, and for analysts and engineers with a few years of experience moving into ML roles. It has 60 questions with model answers in three levels: the basics every fresher is asked, then the practical questions on metrics, validation, leakage and tuning that come up for 1-4 years of experience, and finally senior questions on model internals, deployment, drift and explaining models to business teams. The worked numbers in the answers are small enough to check by hand. Try each answer aloud before reading ours, then take the mock test to practise under time pressure.

Questions you may be asked

  1. What is machine learning, and how is it different from traditional programming?
  2. What is the difference between supervised and unsupervised learning?
  3. How do you decide whether a problem is classification or regression?
  4. Why do we split data into training, validation and test sets?

Get IT jobs in Bangalore by email

Create a free profile and we email you new IT jobs in Bangalore, at most once a week.

Similar jobs

Field Sales Engineer

V Technologies
Mumbai, Thane
B2B SalesClient Relationship ManagementCustomer Relationship ManagementField Sales+4
Full time On-site 16 hr ago

Free · takes a minute · your resume fills your profile