Free · takes a minute · your resume fills your profile
CoreHRx never asks candidates for money. If anyone does, .
Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.
As a Senior Data Engineer, you will:
• Design, develop, and support scalable batch and near real-time data pipelines, data products, and lakehouse-ready data assets using Spark, Python, SQL, Hive, Databricks, and cloud-native technologies.
• Build and optimize capabilities supporting the ONE Data Lake and Mastercard's unified data platform strategy.
• Develop ingestion, transformation, and orchestration solutions for batch and streaming/near real-time data patterns using technologies such as Cribl, SSIS, Apache Ozone, Cloudera Data Services, Hive, Spark, Azure, Microsoft Fabric, Databricks, and related ecosystem tools.
• Enable trusted, governed, and accessible enterprise data through the implementation of data quality, lineage, and governance standards.
• Partner closely with Product, TPM, Data Governance, Architect, and Engineering teams to deliver strategic business outcomes.
• Support AI, analytics, reporting, and decisioning use cases by delivering scalable and reliable data assets.
• Drive modernization initiatives across hybrid data environments and cloud.
• Improve operational efficiency through automation, monitoring, observability, and self-service capabilities.
• Troubleshoot complex platform and data issues, perform root cause analysis, and implement sustainable solutions.
• Evaluate emerging technologies and identify opportunities to advance Team ONE's data capabilities.
Required Qualifications
• 6+ years of experience delivering enterprise-scale data engineering, data warehousing, or big data solutions.
• Strong hands-on experience with Apache Spark, Python, SQL and Databricks.
• Experience building and maintaining large-scale data pipelines and distributed data processing systems.
• Experience with streaming or near real-time ingestion patterns, including event/log data collection, routing, transformation, and delivery into enterprise data lake or lakehouse platforms.
• Experience with Hive, Apache Ozone, or similar data integration, Azure, Microsoft Fabric, and orchestration technologies.
• Strong understanding of data architecture, ETL/ELT design patterns, and modern data platform principles.
• Hands-on experience with Microsoft SQL Server, SSIS packages, stored procedures, SQL performance tuning, and relational database concepts.
• Experience implementing data quality, governance, metadata, and lineage capabilities.
• Proven ability to analyze complex production issues, perform root cause analysis, and implement long-term solutions.
• Strong communication and collaboration skills with the ability to work effectively across technical and business teams.
• Demonstrated ability to manage competing priorities in a fast-paced environment.
• Strong ownership mindset and commitment to delivering high-quality solutions.
As a Senior Data Engineer, you will:
• Design, develop, and support scalable batch and near real-time data pipelines, data products, and lakehouse-ready data assets using Spark, Python, SQL, Hive, Databricks, and cloud-native technologies.
• Build and optimize capabilities supporting the ONE Data Lake and Mastercard's unified data platform strategy.
• Develop ingestion, transformation, and orchestration solutions for batch and streaming/near real-time data patterns using technologies such as Cribl, SSIS, Apache Ozone, Cloudera Data Services, Hive, Spark, Azure, Microsoft Fabric, Databricks, and related ecosystem tools.
• Enable trusted, governed, and accessible enterprise data through the implementation of data quality, lineage, and governance standards.
• Partner closely with Product, TPM, Data Governance, Architect, and Engineering teams to deliver strategic business outcomes.
• Support AI, analytics, reporting, and decisioning use cases by delivering scalable and reliable data assets.
• Drive modernization initiatives across hybrid data environments and cloud.
• Improve operational efficiency through automation, monitoring, observability, and self-service capabilities.
• Troubleshoot complex platform and data issues, perform root cause analysis, and implement sustainable solutions.
• Evaluate emerging technologies and identify opportunities to advance Team ONE's data capabilities.
Required Qualifications
• 6+ years of experience delivering enterprise-scale data engineering, data warehousing, or big data solutions.
• Strong hands-on experience with Apache Spark, Python, SQL and Databricks.
• Experience building and maintaining large-scale data pipelines and distributed data processing systems.
• Experience with streaming or near real-time ingestion patterns, including event/log data collection, routing, transformation, and delivery into enterprise data lake or lakehouse platforms.
• Experience with Hive, Apache Ozone, or similar data integration, Azure, Microsoft Fabric, and orchestration technologies.
• Strong understanding of data architecture, ETL/ELT design patterns, and modern data platform principles.
• Hands-on experience with Microsoft SQL Server, SSIS packages, stored procedures, SQL performance tuning, and relational database concepts.
• Experience implementing data quality, governance, metadata, and lineage capabilities.
• Proven ability to analyze complex production issues, perform root cause analysis, and implement long-term solutions.
• Strong communication and collaboration skills with the ability to work effectively across technical and business teams.
• Demonstrated ability to manage competing priorities in a fast-paced environment.
• Strong ownership mindset and commitment to delivering high-quality solutions.
Required Qualifications
• 6+ years of experience delivering enterprise-scale data engineering, data warehousing, or big data solutions.
• Strong hands-on experience with Apache Spark, Python, SQL and Databricks.
• Experience building and maintaining large-scale data pipelines and distributed data processing systems.
• Experience with streaming or near real-time ingestion patterns, including event/log data collection, routing, transformation, and delivery into enterprise data lake or lakehouse platforms.
• Experience with Hive, Apache Ozone, or similar data integration, Azure, Microsoft Fabric, and orchestration technologies.
• Strong understanding of data architecture, ETL/ELT design patterns, and modern data platform principles.
• Hands-on experience with Microsoft SQL Server, SSIS packages, stored procedures, SQL performance tuning, and relational database concepts.
• Experience implementing data quality, governance, metadata, and lineage capabilities.
• Proven ability to analyze complex production issues, perform root cause analysis, and implement long-term solutions.
• Strong communication and collaboration skills with the ability to work effectively across technical and business teams.
• Demonstrated ability to manage competing priorities in a fast-paced environment.
• Strong ownership mindset and commitment to delivering high-quality solutions.
Preferred Qualifications
• Experience with Cribl or similar observability/log streaming platforms, including data routing, filtering, enrichment, and delivery to downstream lakehouse or analytics platforms.
• Experience with Microsoft Fabric, OneLake, and cloud-native data platforms.
• Experience with enterprise data governance and metadata management solutions.
• Experience supporting analytics, reporting, AI, or machine learning workloads.
• Experience with Power BI and enterprise reporting environments.
• Experience mentoring engineers and leading technical initiatives.
Most IT Jobs posts in Pune ask for 3–6 years of experience (44% of 1526 that say).
From live job posts on CoreHRx, updated 21 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.
The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹15L – ₹28L a year (typical for IT Jobs in Pune, 63 posts).
The post asks for 6 Yrs experience.
In Pune.
It is a full time job.
Interview preparation · 60 questions
This guide is for freshers in India preparing for cloud and support roles, and for developers, administrators and cloud engineers with 1 to 10 years of experience facing Microsoft Azure interviews. It has 60 questions with answers in three levels: core concepts such as regions, resource groups, Microsoft Entra ID, VMs, storage and networking; day-to-day work with Bicep, App Service, Functions, AKS, Azure SQL, KQL and Azure Policy; and senior design questions on high availability, security and cost. Read each answer, then explain it aloud in your own words and take the mock test. The questions are written by CoreHRx for practice. CoreHRx is not affiliated with or endorsed by Microsoft, and these are not actual Azure certification exam questions. Azure changes often, so check the official documentation for current details.
Questions you may be asked
Create a free profile and we email you new IT jobs in Pune, at most once a week.