₹15L – ₹25L a year estimatetypical for IT Jobs in Bangalore, 259 posts
Posted 5 months ago Last checked 2 days ago
Free · takes a minute · your resume fills your profile
CoreHRx never asks candidates for money. If anyone does, .
Role at a glance
You will
Design and build evaluation harnesses for agentic systems in Python
Author automated test suites for prompts, tools, structured outputs, and end-to-end agent workflows
Validate guardrails around tool execution
Experience
6+ years
Must-have skills
DockerGitPyTestPythonREST API DevelopmentSQL
Work mode
Hybrid
How well do your skills match this job?
Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.
Job description
Location: Bengaluru, Karnataka Department: Data Science
Join Kobie's India Tech Hub as a Lead AI QA Engineer. You'll design test strategies and evaluation harnesses for production-grade, agentic AI systems, and work with ETL. You need 6+ years of experience, strong Python skills, and hands-on experience testing LLM-powered features.
Responsibilities:
Design and build evaluation harnesses for agentic systems in Python
Author automated test suites for prompts, tools, structured outputs, and end-to-end agent workflows
Validate guardrails around tool execution
Wire evaluations into CI using Dataiku Evaluations, GitHub Actions, or Jenkins
Build observability into testing
Own quality end-to-end
Partner with data engineers and platform teams
Help shape internal QA standards for AI & Data engineering
Requirements:
3+ years of professional QA / SDET experience
1+ years of hands-on experience testing LLM or AI features in production
Working knowledge of evaluation frameworks such as RAGAS, DeepEval, LangSmith, Langfuse
Strong Python and PyTest skills
Solid SQL skills and comfort with at least one cloud platform
Fluency with Git, Docker, REST APIs, and at least one CI tool
Solid understanding of data security and responsible AI practices
Nice to Have:
Hands-on experience with Dataiku DSS
Experience with Dataiku LLM Mesh, Knowledge Banks, Prompt Studio, or Visual / Code Agents
Experience with Snowflake, Snowpark, or Snowflake Cortex
Experience with red-teaming, prompt-injection testing, or adversarial test generation for LLMs
₹15L – ₹25Ladvertised yearly salary for IT Jobs in Bangalore (middle half of 259 posts that show a salary; median ₹19L)
Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 3928 that say).
Hiring most for IT Jobs in Bangalore
Bosch Group173 open jobs
Trigent Software Private Limited138 open jobs
Brillio117 open jobs
Jobs asking for Docker in Bangalore also ask for
Kubernetes80%
AWS63%
CI/CD60%
Python60%
Microsoft Azure47%
From live job posts on CoreHRx, updated 11 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.
Questions about this job
What is the salary for this Lead AI QA Engineer job?
The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹15L – ₹25L a year (typical for IT Jobs in Bangalore, 259 posts).
This page helps Indian job seekers prepare for Python interviews for backend, data engineering and data analyst roles, whether you are a fresher facing your first technical round or an experienced developer aiming for a senior position. It has 60 questions in three levels, easy, medium and hard, each with a concise sample answer and, where it helps, runnable Python 3.12 code. Topics include data structures, OOP, generators, decorators, the GIL and concurrency, type hints, testing and performance. Answer each question aloud in your own words first, then compare with the sample answer and run the code to check your understanding.
Questions you may be asked
What is the difference between mutable and immutable types in Python?
What is the difference between a list and a tuple?
