Lead Data Engineer
| Company | The Walt Disney Company |
|---|---|
| Location | Seattle, WA, USA, Santa Monica, CA, USA, New York, NY, USA |
| Salary | $152200 – $213900 |
| Type | Full-Time |
| Degrees | Bachelor’s |
| Experience Level | Senior, Expert or higher |
Requirements
- Bachelor’s degree in Computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
- 7+ years of related big data engineering experience modeling and developing large data pipelines
- Deep hands-on experience with distributed systems such as Hadoop or Databricks compute using tools/libraries such as Spark, Presto, Hive to query and process large datasets at the petabyte level.
- Strong Python, Scala and SQL skills processing big datasets
- Strong Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
- Deep understanding of Data Modeling techniques and Data Warehousing standard methodologies and practices
- Operational experience in multi-system/services production environment as lead data engineer and point-of-contact / SME
- Strong problem solving skills with strong attention to detail and excellent analytical and communication skills
- Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD
- Solid experience with AWS S3
Responsibilities
- Build and maintain product-driven initiatives to improve and expand Identity and Device data product offerings
- Enhance/improve the underlying codebase to be extensible, reusable, and maintainable
- Enhance/redesign existing data models with input from Architecture in order to modernize products and/or improve performance and efficiency
- Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
- Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
- Participate in on-call support
- Serve as an advanced resource to other Data Engineers on the team, and mentor and coach junior members of the team helping to improve their skills, knowledge, and productivity.
- Participate in code reviews and problem-solving.
Preferred Qualifications
- Demonstrated ability with cloud infrastructure technologies, including Terraform.