CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Senior Data Engineer

TaskUs

Full time Remote
Experience
5+ years
Work mode
Remote
Posted 2 days ago Last checked 2 days ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Pipeline Engineering: Build and maintain high-throughput ETL/ELT pipelines that ingest data from various sources into our Lakehouse.
  • Code Quality & Tooling: Drive the adoption of dbt for transformation and PySpark for heavy lifting.
  • You will be responsible for writing modular, reusable code that follows strict CI/CD practices.
Experience
5+ years
Must-have skills
AirflowApache SparkCloudFormationData EngineeringDatabricksKafka
Work mode
Remote

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Location: Chennai, India
Department: Engineering

TaskUs is seeking a Senior Data Engineer to join their team. As a Senior Data Engineer, you will be the engine room of our data strategy, building resilient, self-healing systems that transform raw data into high-fidelity data products.

You will take the Architect's blueprints and turn them into production-grade code, ensuring there is clean and reliable data.

Responsibilities:

  • Pipeline Engineering: Build and maintain high-throughput ETL/ELT pipelines that ingest data from various sources into our Lakehouse.
  • Code Quality & Tooling: Drive the adoption of dbt for transformation and PySpark for heavy lifting. You will be responsible for writing modular, reusable code that follows strict CI/CD practices.
  • Observability & Reliability: Implement "Data SLAs." You will build the monitoring and alerting systems that notify the team of data drift or pipeline failures before the business notices.
  • Data Productization: Work closely with the BI team and Data Scientists to prepare "feature-ready" datasets.
  • Performance Tuning: Deep-dive into SQL and Spark query plans to optimize slow-running jobs, reducing cost and latency.
  • Local Development Advocacy: Implementing a workflow where engineers can develop and test complex SQL transformations locally using DuckDB, drastically reducing "waiting-for-cluster" time and lowering development costs.
  • Cost-Efficient Micro-Pipelines: Building specialized pipelines for specific client reporting or data-quality checks that run on single-node containers (e.g., Lambda or small ECS tasks) using DuckDB, avoiding the minimum billing cycles of larger warehouses.
  • Embedded Analytics: Exploring ways to use DuckDB as an embedded engine for internal tools or "edge" processing within the BPO's local site offices where bandwidth to the cloud might be a constraint.

Requirements:

  • 5+ Years in Data Engineering
  • Expert-level proficiency in Python, SQL, and PySpark
  • Modern Lakehouse Stack: Hands-on experience with Databricks (Delta Lake) or Snowflake
  • Transformation & Modeling: Advanced experience with dbt (Data Build Tool)
  • Orchestration: Experience with Apache Airflow or Prefect
  • Streaming Experience: Familiarity with Kafka, Kinesis, or Spark Streaming
  • Infrastructure as Code (IaC): Comfort with Terraform or CloudFormation
  • In-Process Analytics (DuckDB): Proven experience using DuckDB for high-speed local development, unit testing data transformations, or as a query engine for "small-to-medium" datasets
  • Hybrid Execution Patterns: Ability to identify when to use heavyweight compute (PySpark/Databricks) versus lightweight compute (DuckDB/Python) to minimize cloud costs and reduce job latency.

What We Offer: At TaskUs, we prioritize our employees' well-being by offering competitive industry salaries and comprehensive benefits packages. Our commitment to a People First culture is reflected in the various departments we have established, including Total Rewards, Wellness, HR, and Diversity.

Key skills

Required

AirflowApache SparkCloudFormationData EngineeringDatabricksKafkaPythonSQLTerraformUnit QA & Testingdbt

Job market insights

383active Airflow jobs in India
481active Apache Spark jobs in India
222active CloudFormation jobs in India
34 more open jobs at TaskUs

Jobs asking for Airflow in India also ask for

  • Python78%
  • SQL64%
  • AWS54%
  • Data Engineering49%
  • CI/CD46%

From live job posts on CoreHRx, updated 19 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

How much experience does this job need?

The post asks for 5 Yrs experience.

Where is this job based?

It is a remote job.

What kind of job is this?

It is a full time job.

This page helps Indian job seekers prepare for Python interviews for backend, data engineering and data analyst roles, whether you are a fresher facing your first technical round or an experienced developer aiming for a senior position. It has 60 questions in three levels, easy, medium and hard, each with a concise sample answer and, where it helps, runnable Python 3.12 code. Topics include data structures, OOP, generators, decorators, the GIL and concurrency, type hints, testing and performance. Answer each question aloud in your own words first, then compare with the sample answer and run the code to check your understanding.

Questions you may be asked

  1. What is the difference between mutable and immutable types in Python?
  2. What is the difference between a list and a tuple?
  3. What is the difference between is and ==?
  4. What are *args and **kwargs?

Get IT jobs you can do remotely by email

Create a free profile and we email you new IT jobs you can do remotely, at most once a week.

Similar jobs

Free · takes a minute · your resume fills your profile