Posted in

Data Engineer

Data Engineer

CompanyManulife Financial
LocationToronto, ON, Canada
Salary$75880 – $140920
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • Bachelor’s in computer/IT or data related fields required
  • 5+ years of previous data engineering experience, with 3+ years of experience working in enabling azure related data technologies
  • Solid understanding of Azure infrastructure; subscriptions, resource groups, resources, access control with RBAC (role-based access control), integrations with Azure AD and Azure security principles (user group, service principal, managed identity), network concepts (VNet, Subnet, NSG rules, private endpoints), passwordcredentialkey management and data protection
  • Excellent knowledge of Data visualization: PowerBI
  • Strong hands on knowledge of Azure Databricks (Unity Catalog), ADF, ADLS, Synapse Serverless/dedicated/spark pools, Python, PySpark, and T-SQL along with experience designing and developing scripts for ETL processes and automation in Azure data factory and Azure databricks
  • High proficiency in GIT/Jenkins/dev ops processes to maintain and resolve issues with data pipelines in prod
  • Knowledge of implementing azure technologies and networking via terraform along with ability to fix issues with Azure infra in prod
  • Good understanding of data modeling/data marts/Lake house architecture, SCD , data mesh and delta lake overall
  • Solid understanding of data privacy and compliance regulations and standard methodologies for preserving customer data

Responsibilities

  • Gain deep understanding of data by collaborating with business and advanced analytics partners; demonstrate the understanding to design, curate and publish connected data sets that enables users to self-serve
  • Propose technology improvements or come up with innovative solutions to solve business problems
  • Collaborate with Architecture, security and risk teams and implement latest guidelines and Azure standard methodologies
  • Automate infrastructure provisioning and deployment using tools such as terraform
  • Implement CI/CD pipelines that enables automated code deployment
  • Participate in Agile sprints and ceremonies; supports rapid iteration and development
  • Cultivate and maintain strong relationships and fosters collaboration with various teams and partners within the organization

Preferred Qualifications

  • Knowledge of insurance and financial products is a plus