Posted in

Staff Data Engineer

Staff Data Engineer

CompanySovrn
LocationBoulder, CO, USA
Salary$165000 – $200000
TypeFull-Time
Degrees
Experience LevelSenior, Expert or higher

Requirements

  • 7+ years of software engineering experience and a passion for learning
  • Strong scala and python skills with an expert understanding of backend and data engineering design patterns
  • A deep understanding of big data processing environments such as Spark and Databricks.
  • Demonstrated experience with data processing using Spark in a production environment.
  • Proven experience with orchestration tools such as Airflow and MWAA.
  • Experience working in the Cloud Computing ecosystem. We use AWS heavily, but we are open to GCP, Azure, etc.
  • Experience with infrastructure as code tools like Terraform and AWS CloudFormation.
  • Deep understanding of relational databases, big data tables, and noSQL databases.
  • Able to triage, debug, and permanently fix complex and convoluted data processing issues.
  • Possesses a mature understanding of the product domain and architecture.

Responsibilities

  • Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications.
  • Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies.
  • Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
  • Architect components and configurations required for data pipeline implementation in AWS and Databricks.
  • Architect data pipeline metrics to monitor performance, accuracy, and availability.
  • Enable a team to research, implement, and evolve methods to process our data.
  • Optimize data processing and data access to business intelligence tools.
  • Work across the organization to enable business growth and development through data services and data models.
  • Spot and diagnose stability issues and author improvements.
  • Lead the developers with the security team to implement and maintain robust data security measures.
  • Ensure compliance with relevant data governance and privacy regulations.

Preferred Qualifications

  • Desire for professional growth opportunities and to be in a dynamic learning environment
  • Ability to efficiently multi-task and to work cooperatively and collaboratively with all levels of employees to maximize performance, creativity, problem solving and results
  • A creative yet analytical mindset with strong problem-solving skills.
  • Excellent communication and collaboration skills.
  • Quick to willingly jump in and help others when they are struggling with issues.