Profile
user

View & Update Profile
Logout

InfoBeans Technologies - Data Engineer - Azure Databricks

InfoBeans

Full time On-site
Experience
10–13 years
Location
Indore
Work mode
On-site
Salary
₹11L – ₹24L a year estimatetypical for IT Jobs in India, 846 posts
Posted 3 days ago

Role at a glance

You will
  • The role involves designing and developing scalable data processing solutions, building reusable frameworks, optimizing data transformation…
  • Design, develop, and maintain scalable data processing solutions using Python and PySpark.
  • Write complex SQL queries for data extraction, transformation, validation, reconciliation, and analysis.
Experience
10–13 years
Must-have skills
Apache SparkData EngineeringData Structures & AlgorithmsDatabricksELTETL

Job description

About The Role

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, PySpark, SQL, and cloud-based data engineering. The role involves designing and developing scalable data processing solutions, building reusable frameworks, optimizing data transformation pipelines, and delivering reliable data solutions using Azure Databricks and Azure Data Factory (ADF).

Key Responsibilities

  • Design, develop, and maintain scalable data processing solutions using Python and PySpark.
  • Write complex SQL queries for data extraction, transformation, validation, reconciliation, and analysis.
  • Build and maintain robust data pipelines and workflows using Azure Databricks and Azure Data Factory (ADF).
  • Develop reusable, modular, and scalable code frameworks to support efficient data engineering.
  • Design and implement data transformations and processing logic for large datasets.
  • Develop solutions from scratch, following clean coding practices, reusable design patterns, and comprehensive documentation standards.
  • Optimize existing code, Spark jobs, SQL queries, and data pipelines to improve performance, scalability, and resource utilization.
  • Troubleshoot data pipeline failures, processing bottlenecks, and data quality issues.
  • Collaborate with data engineers, analysts, architects, and business stakeholders.
  • Ensure data accuracy, consistency, integrity, and reliability throughout the data processing lifecycle.
  • Participate in technical design discussions, code reviews, and continuous improvement initiatives.

Required Skills & Experience

  • 10 - 13 years of experience in data engineering, data development, or related software engineering roles.
  • Strong hands-on proficiency in Python, including core programming concepts, data structures, modular design, and reusable code development.
  • Strong experience with PySpark for distributed data processing and large-scale data transformations.
  • Advanced SQL skills, including complex queries, joins, aggregations, analytical functions, and query optimization.
  • Hands-on experience with Azure Databricks for data engineering and transformation workloads.
  • Experience building and orchestrating data pipelines using Azure Data Factory (ADF).
  • Strong understanding of data engineering principles, ETL/ELT processes, data transformation, and pipeline orchestration.
  • Experience designing scalable and reusable data processing frameworks.
  • Experience working with Git, code reviews, testing, and deployment practices.
  • Excellent analytical, communication, and cross-functional collaboration skills.

(ref:hirist.tech)

Key skills

Required

Apache SparkData EngineeringData Structures & AlgorithmsDatabricksELTETLGitMicrosoft AzurePythonQuery OptimizationSQL

Soft skills

CollaborationCommunication

Tags

Cloud EngineerBig DataData and AnalyticsIT JobsData Engineer

Job market insights

214active Apache Spark jobs in India
462active Data Engineering jobs in India
374active Data Structures & Algorithms jobs in India
₹11L – ₹24L advertised yearly salary for IT Jobs in India (middle half of 846 posts that show a salary; median ₹17L)
2 more open jobs at InfoBeans

Jobs asking for Apache Spark in India also ask for

  • Python77%
  • SQL65%
  • AWS50%
  • Databricks50%
  • Data Engineering45%

From live job posts on CoreHRx, updated 20 Oct 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Similar jobs