CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Staff Software Development Test Engineer

Tekion Verified employer

Full time On-site
Experience
8+ years
Location
Bangalore
Work mode
On-site
Salary
₹13L – ₹25L a year estimatetypical for IT Jobs in Bangalore, 268 posts
Posted 4 months ago Last checked 2 hr ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Generative AI & LLM Evaluation
  • Build automated testing suites to detect hallucinations, bias, toxicity, and prompt injection vulnerabilities across LLM-powered products
  • Implement automated evaluations for RAG systems measuring context relevance, groundedness, and answer faithfulness using frameworks like…
Experience
8+ years
Must-have skills
CI/CDData AnalysisDockerGitHub ActionsGrafanaIntegration QA & Testing
Work mode
On-site

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Location: Bangalore HQ
Department: All Cost Centers

About Tekion:

Positively disrupting an industry that has not seen any innovation in over 50 years, Tekion has challenged the paradigm with the first and fastest cloud-native automotive platform that includes the revolutionary Automotive Retail Cloud (ARC) for retailers, Automotive Enterprise Cloud (AEC) for manufacturers and other large automotive enterprises and Automotive Partner Cloud (APC) for technology and industry partners. Tekion connects the entire spectrum of the automotive retail ecosystem through one seamless platform. The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers/dealers and consumers. With its highly configurable integration and greater customer engagement capabilities, Tekion is enabling the best automotive retail experiences ever. Tekion employs close to 3,000 people across North America, Asia and Europe.

Roles & Responsibilities 

Generative AI & LLM Evaluation 

  • Build automated testing suites to detect hallucinations, bias, toxicity, and prompt injection vulnerabilities across LLM-powered products 

  • Implement automated evaluations for RAG systems measuring context relevance, groundedness, and answer faithfulness using frameworks like RAGAS or DeepEval 

  • Design test beds to validate multi-agent workflows — tool-calling accuracy, multi-step reasoning, memory, and autonomous decision loops 

  • Build and run automated conversation simulations — scripted and synthetic user journeys — to stress-test agent behaviour across intents, edge cases, and multi-turn dialog flows 

  • Create prompt regression frameworks to assess how changes in system prompts, temperature, and sampling parameters impact output consistency 

Data Quality Assurance 

  • Statistically validate AI data outputs — distributions, precision/recall, error pattern analysis — to catch silent data quality failures before production 

  • Programmatically audit data ingestion, transformation, and feature store pipelines for schema drift and data corruption 

  • Validate vector DB indexing, embedding semantic similarity accuracy, and retrieval latency 

  • Verify quality, diversity, and privacy compliance of synthetic datasets used for model training and evaluation 

Classical ML & Deep Learning Validation 

  • Maintain automated suites tracking ML metrics — Precision, Recall, F1, ROC-AUC — and deep learning loss curves across model versions 

  • Implement continuous monitoring scripts to detect data and concept drift on live inference endpoints 

Automation Engineering & CI/CD 

  • Build and maintain scalable test automation frameworks for APIs, backend services, and model endpoints 

  • Embed AI evaluation and data QA suites into MLOps and CI/CD pipelines so quality failures block releases automatically 

  • Define and track AI quality KPIs and communicate release readiness to engineering and product teams 

Experience of 8+ years SDET role 

Technical Skills & Frameworks 

Core Programming 

  • Python — expert level; test automation, eval pipelines, data analysis (Pandas, NumPy, Pytest) 

  • SQL — data output validation, ground truth querying, pipeline data quality checks 

GenAI & Evaluation 

  • RAGAS / TruLens / DeepEval / Promptflow etc — LLM evaluation frameworks for measuring faithfulness, hallucination rate, and task success 

  • LangChain / LangSmith / LlamaIndex — agent workflow testing, prompt tracing, and LLM response debugging 

  • OpenAI / Anthropic / Hugging Face APIs — direct LLM endpoint testing and output consistency validation 

  • Vector DBs — retrieval quality testing, embedding validation, and latency benchmarking 

  • Pandas / NumPy etc. — statistical analysis for output validation and error pattern investigation, data profiling, schema validation, and pipeline integrity checks 

API & Automation 

  • Pytest — modular, reusable test framework for AI eval and automation suites 

  • Postman / REST Assured / Requests — API contract validation and service-level integration testing 

MLOps & CI/CD 

  • MLflow — tracking model versions and eval runs to detect regressions across updates 

  • Docker / GitHub Actions / Jenkins — containerised test environments and deployment pipeline automation 

Observability 

  • Grafana / Kibana / OpenTelemetry — monitoring AI system health, output drift, and distributed tracing across agent pipelines 

Good to Have 

  • Cloud AI Services — AWS Bedrock, Azure OpenAI, or GCP Vertex AI for testing managed model endpoints and cloud-deployed agents 

  • MLOps Platforms — MLflow, Kubeflow, Weights & Biases, or Feast feature stores for experiment tracking and model governance 

  • ML Frameworks — Scikit-learn, TensorFlow, or PyTorch familiarity for understanding model internals and validating training pipelines 

  • Infrastructure as Code — Docker, Kubernetes, Terraform for managing containerised test environments at scale 

  • UI Automation — Playwright or Cypress for end-to-end conversational AI application testing 

  • Performance Engineering — Locust or JMeter for load testing heavy AI inference endpoints under peak traffic 

  • Statistical Hypothesis Testing — t-tests, confidence intervals, significance testing to distinguish real quality signal from noise 

  • Synthetic Data Generation — using LLMs to generate diverse test cases and evaluation datasets at scale 

Current Tekion Employees: Please apply via the Internal Job Board in Ashby.

Note: Tekion recently transitioned to a new recruiting tool and we appreciate your patience and feedback as we adjust to our new system!

Tekion is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, victim of violence or having a family member who is a victim of violence, the intersectionality of two or more protected categories, or other applicable legally protected characteristics.

For more information on our privacy practices, please refer to our Applicant Privacy Notice here.

Important: Tekion will only contact candidates from an @tekion.com email address or through our applicant tracking system (no-reply@ashbyhq.com). We may also work with authorized recruiting partners from time to time. Tekion and its recruiting partners will never ask you to pay fees or send money for applications, interviews, training, or onboarding. If you receive a message that seems suspicious, please do not respond or share personal or financial information.

Key skills

Required

CI/CDData AnalysisDockerGitHub ActionsGrafanaIntegration QA & TestingJenkinsMLOpsNumPyOpenTelemetryPandasPostmanPyTestPythonREST AssuredSQLTest Automation

Preferred

AWSCypressGoogle Cloud Platform (GCP)JMeterKubernetesLoad QA & TestingMicrosoft AzurePlaywrightPyTorchScikit-learnTensorFlowTerraform

Job market insights

1,532active CI/CD jobs in Bangalore
439active Data Analysis jobs in Bangalore
799active Docker jobs in Bangalore
₹13L – ₹25L advertised yearly salary for IT Jobs in Bangalore (middle half of 268 posts that show a salary; median ₹18L)
52 more open jobs at Tekion

Most IT Jobs posts in Bangalore ask for 3–6 years of experience (41% of 5595 that say).

Hiring most for IT Jobs in Bangalore

  • Bosch Group207 open jobs
  • Eurofins123 open jobs
  • Brillio118 open jobs

Jobs asking for CI/CD in Bangalore also ask for

  • Python52%
  • AWS46%
  • Microsoft Azure39%
  • Kubernetes37%
  • Docker32%

From live job posts on CoreHRx, updated 22 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

What is the salary for this Staff Software Development Test Engineer job?

The post does not state the pay. As an estimate, comparable posts on CoreHRx advertise ₹13L – ₹25L a year (typical for IT Jobs in Bangalore, 268 posts).

How much experience does this job need?

The post asks for 8 Yrs experience.

Where is this job based?

In Bangalore (on-site).

What kind of job is this?

It is a full time job.

This guide is for freshers and working analysts in India preparing for data analyst interviews at product companies, IT services firms, banks, e-commerce and fintech startups. It has 60 questions with model answers in three levels: the basics every fresher is asked, the real-world problems analysts with one to four years face (wrong joins, messy data, conversion drops), and the senior questions on experiment design, metric traps and leading decisions with data. Every SQL query and every number in the answers was run or calculated. Read the question, answer it aloud in your own words, then compare, and take the mock test to practise under time.

Questions you may be asked

  1. What does a data analyst do, and what does a typical day look like?
  2. How is a data analyst different from a data scientist and a data engineer?
  3. What is the difference between WHERE and HAVING? Show it with a query.
  4. What is the difference between an INNER JOIN and a LEFT JOIN, and why can a customer count drop after a join?

Get IT jobs in Bangalore by email

Create a free profile and we email you new IT jobs in Bangalore, at most once a week.

Similar jobs

Free · takes a minute · your resume fills your profile