Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
Experience
8+ years
Must-have skills
JavaPythonTypeScript
How well do your skills match this job?
Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.
Job description
Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team.
We're seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. You'll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures.
Job responsibilities
Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).
Required qualifications, capabilities and skills
8+ years of software engineering experience, including leading design and delivery of large-scale production systems.
Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements.
Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs)
Proven expertise in context and memory engineering, model evaluation methodologies, and quality measurement.
Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness).
Strong programming skills in one or more of: Python, Java, Go, or TypeScript; plus strong API and distributed-systems fundamentals.
Familiarity with retrieval systems, vector databases, and hybrid search patterns.
Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 4636 that say).
Hiring most for IT Jobs in Bangalore
Bosch Group176 open jobs
Trigent Software Private Limited129 open jobs
Brillio120 open jobs
Jobs asking for Java in Bangalore also ask for
Python53%
AWS43%
CI/CD36%
Microservices33%
Kubernetes30%
From live job posts on CoreHRx, updated 14 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.
Questions about this job
What is the salary for this Lead Software Engineer- AI Agent Developer job?
The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹15L – ₹25L a year (typical for IT Jobs in Bangalore, 269 posts).
This guide is for Indian job seekers preparing for Java backend roles, from freshers facing campus and first-job interviews to experienced developers moving into senior positions at product companies and IT services firms. It covers what interviewers ask most in 2025 and 2026 on Java 17 and 21 and Spring Boot 3: OOP, collections, equals and hashCode, streams, exceptions, concurrency and JVM memory, then dependency injection, auto-configuration, REST controllers, validation, JPA and Hibernate, security, microservices and testing. Questions are grouped as easy, medium and hard. Read each answer, compile the code yourself and practise explaining it aloud.
Questions you may be asked
What are the four pillars of OOP, with a Java example of each?
What is the difference between an abstract class and an interface in Java?
What is the difference between method overloading and method overriding?
What is the difference between == and equals() in Java?