₹15L – ₹25L a year estimatetypical for IT Jobs in Bangalore, 286 posts
Posted 1 year ago Last checked 2 hr ago
Free · takes a minute · your resume fills your profile
CoreHRx never asks candidates for money. If anyone does, .
Role at a glance
You will
As a Lead Data Engineer, you will take ownership of designing and delivering high-performance data platforms that enable analytics, AI/ML…
You will mentor junior engineers, drive architectural decisions, and collaborate with stakeholders to align the data platform roadmap with…
This is a hands-on technical leadership role for someone who enjoys both coding and guiding a team toward innovative solutions.
Experience
6–8 years
Must-have skills
AWSAgileCI/CDData EngineeringDockerGo
Work mode
Hybrid
How well do your skills match this job?
Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.
Job description
Location: Bangalore, Hybrid; Bengaluru, Karnataka, India Department: Engineering
About Arcana
Arcana was recently named one of LinkedIn's Top Startups of 2026, ranking among 50 rising companies in the U.S. alongside Anthropic, Perplexity, Cognition, and others. Arcana is a front-office portfolio intelligence platform built for hedge funds and asset managers. We empower investment professionals—from CIOs and portfolio managers to analysts and risk teams—with the tools to understand performance and risk, construct portfolios, evaluate investments, and make better investment decisions. The institutional investment software stack hasn't kept up with how modern investment teams work, and we're rebuilding it from the ground up.
The Role
As a Lead Data Engineer, you will take ownership of designing and delivering high-performance data platforms that enable analytics, AI/ML, and real-time insights across the organisation. You will mentor junior engineers, drive architectural decisions, and collaborate with stakeholders to align the data platform roadmap with business objectives. This is a hands-on technical leadership role for someone who enjoys both coding and guiding a team toward innovative solutions.
Responsibilities:
Lead the design and implementation of scalable and reliable data pipelines using Distributed Computing, Kafka, Airflow and Temporal.
Architect data solutions that support business analytics, and real-time processing.
Mentor and guide junior engineers, conducting code reviews and setting coding standards.
Collaborate with cross-functional teams to identify and solve data challenges.
Drive improvements in infrastructure, automation, and monitoring to enhance scalability and performance.
Ensure data quality, governance, and compliance with internal policies and industry best practices.
Stay current with the latest data trends and technologies, and make recommendations to keep the platform ahead of the curve.
Requirements:
6-8 years of experience in data engineering or distributed systems.
Strong hands on programming skills in Python / Scala / Rust / Golang, and SQL.
Proven experience with cloud-native services (AWS, GCP) and big data tools (e.g., Spark, Flink, Datafusion, Doris, Trino etc).
Expertise in building real-time pipelines using Kafka, and batch pipelines.
Experience working with CI/CD pipelines, Kubernetes, Docker, and IaC tools.
Demonstrated ability to lead and mentor teams in a fast-paced, agile environment.
Strong problem-solving and communication skills with the ability to collaborate with multiple stakeholders.
Contributions to open-source projects or experience in a fast pace product-based company
What We Offer:
Competitive compensation and benefits package.
Opportunity to work with modern technologies and drive innovation.
Flexible working hours with Hybrid options.
A collaborative environment focused on learning and growth.
Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 3732 that say).
Hiring most for IT Jobs in Bangalore
Bosch Group165 open jobs
Trigent Software Private Limited157 open jobs
Brillio115 open jobs
Jobs asking for AWS in Bangalore also ask for
Microsoft Azure57%
Python54%
Google Cloud Platform (GCP)49%
CI/CD41%
Kubernetes38%
From live job posts on CoreHRx, updated 7 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.
Questions about this job
What is the salary for this Lead Data Engineer job?
The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹15L – ₹25L a year (typical for IT Jobs in Bangalore, 286 posts).
This page is for Indian job seekers preparing for cloud engineer, DevOps, backend and solutions architect roles that list AWS as a skill, whether you are a fresher with a first certification or an experienced engineer moving into a senior role. It covers 60 questions in three levels: core services and concepts, then design and configuration choices for one to three years of experience, and finally scenario, security, cost and troubleshooting questions asked in senior rounds. Read each answer, explain it aloud in your own words, and try the CLI commands in a practice account with a billing alert set.
Questions you may be asked
What is the difference between an AWS Region and an Availability Zone?
Explain the AWS shared responsibility model.
What is Amazon EC2, and how do you read an instance type name like m7g.large?
What is Amazon S3, and what are its main storage classes?
