CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Lead Software Engineer- Data Engineer

Caterpillar

Full time On-site
Experience
10+ years
Location
Bangalore, Chennai
Work mode
On-site
Salary
₹15L – ₹25L a year estimatetypical for IT Jobs in Bangalore, 267 posts
Posted 9 days ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • This platform enables large-scale data ingestion, transformation, and analytics across manufacturing, supply chain, and engineering…
  • The ideal candidate will bring deep expertise in **data engineering, large-scale data ingestion, AWS-based architectures, and Snowflake**…
  • Leadership & Delivery
Experience
10+ years
Education
Bachelor's degree
Must-have skills
AWSCI/CDCloudFormationData EngineeringData ModelingDesign Patterns
Work mode
On-site

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Location: Chennai; Bangalore, India

**Career Area:**

Technology, Digital and Data

**Job Description:**

**Your Work Shapes the World at Caterpillar Inc.**

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

**Software Engineering Lead – Data Platform**

**About the Role**

We are seeking a highly skilled **Software Engineering Lead – Data Platform** to lead the development of Caterpillar’s next-generation Digital Manufacturing Data Platform. This platform enables large-scale data ingestion, transformation, and analytics across manufacturing, supply chain, and engineering ecosystems.

The ideal candidate will bring deep expertise in **data engineering, large-scale data ingestion, AWS-based architectures, and Snowflake**, along with strong leadership and software engineering discipline.

**Key Responsibilities**

  • **Leadership & Delivery**
  • Lead and mentor a team of data engineers and platform developers
  • Drive Agile execution and ensure predictable, high-quality delivery
  • Establish engineering best practices, code quality, and CI/CD standards
  • **Data Platform & Architecture**
  • Architect scalable and secure data platforms on AWS
  • Design robust data ingestion frameworks for batch and near real-time pipelines
  • Define best practices in data modeling, governance, and metadata management
  • **Data Engineering & Ingestion**
  • Lead design and development of scalable ingestion pipelines (structured and unstructured data)
  • Build and optimize Snowflake-based data platforms for performance and cost
  • Enable ingestion of diverse sources (databases, APIs, files, streaming data)
  • **Cloud & Platform Engineering**
  • Leverage AWS services (S3, Glue, Lambda, EMR, Redshift, etc.) for end-to-end pipelines
  • Implement CI/CD pipelines using Azure DevOps / Jenkins
  • Ensure system scalability, resiliency, and operational readiness
  • **Software Engineering Excellence**
  • Enforce software engineering principles (modular design, code quality, testing, version control)
  • Drive automation and continuous improvement
  • Promote reusable frameworks for ingestion and transformation
  • **Stakeholder Collaboration**
  • Partner with product managers, SMEs, and business stakeholders
  • Translate business needs into scalable data solutions

**Must-Have Skills**

  • 10+ years of experience in Data Engineering / Data Platform roles
  • Strong experience in **AWS data ecosystem** (S3, Glue, Lambda, EMR, Redshift)
  • Deep expertise in **Snowflake (architecture, optimization, data modeling)**
  • Strong programming skills in **Python and SQL**
  • Extensive experience with **data ingestion pipelines and ETL/ELT frameworks**
  • Exposure to **real-time streaming (Kafka, Spark Streaming)**
  • Experience with **CI/CD tools** (GitHub, Jenkins, AWS CloudFormation etc.)
  • Solid understanding of **distributed systems and scalable architectures**
  • Strong foundation in **software engineering principles (Git, testing, design patterns)**
  • Experienced in working with Agile teams
  • Collaborate with Data Science and AI teams to operationalize ML models and analytics workflows.
  • Promote integration of AI capabilities into data engineering pipelines (e.g., GenAI, MCP, ATA).
  • Support real-time analytics and edge AI use cases in manufacturing environments.
  • Use AI extensively in building and testing Data Ingestion and Data pipeline

**Nice-to-Have Skills**

  • Experience with **Graph Databases** (Neo4j, Neptune)
  • Experience with **Vector Databases** (Milvus, OpenSearch)
  • Knowledge of **NVIDIA ecosystem and RAPIDS (cuDF, cuML, cuGraph)**
  • Experience integrating AI/ML pipelines or GenAI workflows

**Qualifications**

  • Bachelor’s or Master’s degree in Computer Science / Engineering
  • Proven track record in leading engineering teams and delivering at scale
  • Strong leadership, communication, and stakeholder management skills

This position requires working onsite five days a week.

Relocation is available for this position.

**Posting Dates:**

November 4, 2026 - November 12, 2026

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply

Not ready to apply? Join our [Talent Community](http://flows.beamery.com/caterpillarinc/talcom).

There’s more to work at Caterpillar than just the work itself. We hire smart, friendly people and it shows in our culture. We hold ourselves to high standards and make sure our values of integrity, excellence, teamwork, commitment and sustainability come to life in the way we work. We make sure our employees feel continuously challenged while also supported. We provide professional growth opportunities, including leadership programs. We celebrate the diversity of our team, while also working together as one Caterpillar.

Our culture, like everything at our company, is made possible by each employee’s contribution. Person by person, we create the environment we work in, and we are proud of the Caterpillar we’ve built.

Job data: Headcount Labs (headcountlabs.com), ODbL 1.0. The job description belongs to the employer. Location data © OpenStreetMap contributors and Overture Maps.

Key skills

Required

AWSCI/CDCloudFormationData EngineeringData ModelingDesign PatternsELTETLGitJenkinsKafkaPythonSQLStakeholder ManagementSnowflake

Soft skills

CommunicationLeadership

Job market insights

1,364active AWS jobs in Bangalore
1,193active CI/CD jobs in Bangalore
75active CloudFormation jobs in Bangalore
₹15L – ₹25L advertised yearly salary for IT Jobs in Bangalore (middle half of 267 posts that show a salary; median ₹19L)
92 more open jobs at Caterpillar

Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 4565 that say).

Hiring most for IT Jobs in Bangalore

  • Bosch Group175 open jobs
  • Trigent Software Private Limited129 open jobs
  • Brillio114 open jobs

Jobs asking for AWS in Bangalore also ask for

  • Microsoft Azure58%
  • Python55%
  • Google Cloud Platform (GCP)49%
  • CI/CD40%
  • Kubernetes38%

From live job posts on CoreHRx, updated 13 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

What is the salary for this Lead Software Engineer- Data Engineer job?

The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹15L – ₹25L a year (typical for IT Jobs in Bangalore, 267 posts).

How much experience does this job need?

The post asks for 10 Yrs experience.

Where is this job based?

In Bangalore, Chennai (on-site).

What kind of job is this?

It is a full time job.

This page is for Indian job seekers preparing for cloud engineer, DevOps, backend and solutions architect roles that list AWS as a skill, whether you are a fresher with a first certification or an experienced engineer moving into a senior role. It covers 60 questions in three levels: core services and concepts, then design and configuration choices for one to three years of experience, and finally scenario, security, cost and troubleshooting questions asked in senior rounds. Read each answer, explain it aloud in your own words, and try the CLI commands in a practice account with a billing alert set.

Questions you may be asked

  1. What is the difference between an AWS Region and an Availability Zone?
  2. Explain the AWS shared responsibility model.
  3. What is Amazon EC2, and how do you read an instance type name like m7g.large?
  4. What is Amazon S3, and what are its main storage classes?

Get IT jobs in Bangalore by email

Create a free profile and we email you new IT jobs in Bangalore, at most once a week.

Similar jobs

Telecaller

Eduflourish
Bangalore East
Admissions CounsellingBusiness DevelopmentCommunicationTelesales
Full time On-site 4 days ago

Free · takes a minute · your resume fills your profile