Senior Data Engineer

Location: Bengaluru, Karnataka, India
Department: Data Engineering & Analytics

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond.

What you'll do

• Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets
• Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains
• Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership
• Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes
• Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources
• Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts 
• Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development
• Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration
• Ensure flexibility with availability during evening hours

What we're looking for

• Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt 
• 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
• Hands-on experience with RDBMS such as MySQL, MS SQL Server, and Postgres
• Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
• Ability to deliver high standards of code quality, system reliability, and performance
• Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency
• Strong proficiency in Terraform is a must-have.

Our Stack

• Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)
• Datastores: MySQL, PostgreSQL, Snowflake
• Cloud: AWS
• Version control: Git & GitHub
• AI Tooling: Copilot on GitHub
• Observability: Datadog

When you join Metropolis, you’ll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

Metropolis may utilize an automated employment decision tool (AEDT) to assess or evaluate your candidacy for employment or promotion. AEDTs are used to assist in assessing a candidate’s application relative to the required job qualifications and responsibilities listed in the job posting.

As part of this process, Metropolis retains data relevant to your candidacy, including personal information, for a period that is reasonably necessary for the use of the tool. If you are hired for the position, your data may become part of your employee records.

Metropolis Technologies is an equal opportunity employer. We make all hiring decisions based on merit, qualifications, and business needs — without regard to race, color, religion, sex (including gender identity, sexual orientation, and pregnancy), national origin, disability, veteran status, or any other protected characteristic under federal, state, or local law.

We are committed to providing a welcoming, accessible hiring experience. If you need a reasonable accommodation for any part of the application or interview process, please reach out to us at recruiting@metropolis.io.