Posted in

Senior Data Engineer

Senior Data Engineer

CompanyKiddom
LocationSan Francisco, CA, USA
Salary$160000 – $180000
TypeFull-Time
DegreesBachelor’s, Master’s
Experience LevelSenior, Expert or higher

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.
  • 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering)
  • Expertise with RDMS and Data Warehousing, demonstrating ability to design and optimize data pipelines, systems and architectures.
  • Experience in managed services for data ingestion/processing with hands-on experience working in AWS environments and operational experience with deploying infrastructure on AWS using Terraform.
  • Expert-level knowledge of SQL and a solid understanding of NoSQL & graph databases (e.g., Cassandra, Neptune).
  • Experience with distributed compute platforms and frameworks, such as Kubernetes/ECS, AWS Lambdas, Spark and distributed storage systems.
  • Expertise with any of data orchestration platforms such as Airflow, Dagster, Prefect or similar frameworks.

Responsibilities

  • Design, build, and maintain scalable data pipelines to transform raw data into analytics-ready datasets.
  • Ensure optimal performance, reliability, and efficiency of the data pipelines.
  • Monitor and Deploy the data infrastructure for performance bottlenecks and implement optimizations as necessary.
  • Collaborate with other engineering teams to ensure seamless data integration with high availability.
  • Leverage SQL, DBT, Golang, Python, Terraform and AWS tools to enhance our data infrastructure.
  • Keep the Kiddom team updated on the latest advancements in AI and data engineering tools and best practices.

Preferred Qualifications

    No preferred qualifications provided.