Software Engineer II – Data

February 12, 2023
Apply Now

Job Description

Batch : 2016 & before

—- What the Candidate Will Do —-

  • Responsible for defining the Source of Truth (SOT), Dataset designfor multiple Uber teams.
  • Identify unified data models collaborating with Data Science teams
  • Streamline data processing of the original event sources and consolidate them in source of truth event logs
  • Build and maintain real-time/batch data pipelines that can consolidate and clean up usage analytics
  • Build systems that monitor data losses from the different sources and improve the data quality
  • Own the data quality and reliability of the Tier-1 & Tier-2 datasets including maitaining their SLAs, TTL and  consumption
  • Devise strategies to consolidate and compensate the data losses by correlating different sources
  • Solve challenging data problems with cutting edge design and algorithms.

—- Basic Qualifications —-

  • 7+ years of extensive Data engineering experience working with large data volumes and different sources of data.
  • Strong data modeling skills, domain knowledge and domain mapping experience.
  • Strong experience of using SQL language and writing complex queries.
  • Experience with using other programming languages like  Java, Scala, Python
  • Good problem solving and analytical skills
  • Good communication, mentoring and collaboration skills.

—- What the Candidate Will Do —-

  • Extensive experience in data engineering and working with Big data
  • Experience with ETL or Streaming data and one or more of, Kafka, HDFS, Apache Spark , Apache Flink , Hadoop
  • Experience backend services and familiarity with one of the cloud platform ( AWS/ Azure / Google cloud)