Posted in

Staff Data Engineer

Staff Data Engineer

CompanyAiDash
LocationPalo Alto, CA, USA
Salary$190000 – $230000
TypeFull-Time
DegreesBachelor’s
Experience LevelSenior, Expert or higher

Requirements

  • 8+ years of experience in data and software engineering
  • 4+ years experience in building data pipes, datalakes and datawarehouse
  • Expertise in writing complex data transformations in SQL, Python & Spark
  • Knowledge of data warehousing concepts around building custom ETL integrations, and building data infrastructure (SCD, CDC, Snapshots, indexing, partitioning)
  • Knowledge of Data Security and Governance (nice to have)
  • BS/BA in a technical field such as Computer Science or Mathematics

Responsibilities

  • Design, build, scale, and optimize our data pipelines for ingesting and transforming data
  • Help build out our data lake and real-time infrastructure, and tooling on AWS
  • Support data science, machine learning, analytics, and business operations functions
  • Monitor and maintain pipelines and infrastructure to uphold internal SLAs

Preferred Qualifications

  • Knowledge of satellite-generated data and geo-spatial technologies