Senior Data Engineer
Company | Guardian Life |
---|---|
Location | Holmdel, NJ, USA, Pittsfield, MA, USA, New York, NY, USA, Bethlehem, PA, USA |
Salary | $96960 – $159300 |
Type | Full-Time |
Degrees | Bachelor’s |
Experience Level | Senior, Expert or higher |
Requirements
- Bachelor’s degree in STEM related field or equivalent.
- 7 + years of experience in Data Engineering or similar role.
- Strong understanding of data engineering principles, best practices, and software development life cycle.
- Proficiency in SQL, Python, PySpark and bash scripts.
- Knowledge of Databricks.
- Experience with the design and development of ETL/ELT process.
- Experience working in a Datawarehouse.
- Understanding of Data modeling and in particular Dimension modeling.
- Proven experience in designing and implementing robust data models and data pipelines.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills to work across multiple groups within the organization.
Responsibilities
- Mentor junior data engineers and contribute to establishing best practices for data engineering.
- Design, build and maintain robust & scalable data pipelines to feed descriptive analytics, predictive analytics, and reporting use cases.
- Work closely with business partners, data scientists & BI team to understand the business process, data needs and translate them into an effective data solution.
- Construct meaningful data assets sourced from structured, semi structured, and unstructured data.
- Ensure data quality, accuracy and integrity of the data assets created.
- Automate the data pipelines end to end.
- Participate in data modeling and schema design.
- Collaborate with cross-functional teams to identify the right data sources for the use cases.
- Perform data discovery and analysis on various data sources.
- Find and tell the compelling narrative of the data that aligns to the intended audience.
- Create and maintain Data Dictionary for the data pipelines.
- Participate in code reviews and documentation efforts to maintain high-quality code and data documentation.
Preferred Qualifications
- Experience in Alteryx is a plus.