Posted in

Intermediate Data Engineer

Intermediate Data Engineer

CompanyMaintainX
LocationMontreal, QC, Canada
Salary$Not Provided – $Not Provided
TypeFull-Time
Degrees
Experience LevelMid Level

Requirements

  • 3+ years of experience as a data engineer using Databricks
  • Strong Python and SQL skills
  • Experience with a cloud platform (We use AWS)
  • Experience developing and monitoring ELT/ETL pipelines
  • Experience working in an agile environment

Responsibilities

  • Build, maintain, and scale data pipelines across several business pillars, including extract and load from third party APIs and databases from our products
  • Model raw data into clean, reliable datasets that power both product features and internal analytics
  • Improve observability, testing, and monitoring to ensure reliability and performance
  • Manage data security, compliance and access
  • Collaborate with engineering, machine learning, product, and analytics teams to support their data use cases
  • Help establish platform foundations: CI/CD, documentation, best practices

Preferred Qualifications

  • Experience with dbt, AWS DMS, Fivetran, and/or terraform
  • Experience building CI/CD workflows for Databricks data pipelines (DABs, GitHub Actions, etc.)
  • Experience in query optimization, resource allocation and management, cost management, and data lake performance
  • Experience with cloud infrastructure (Kubernetes, Terraform, etc.)
  • Experience with real-time or data-streaming pipelines
  • Experience deploying and scaling ML solutions using open-source frameworks (MLFlow, etc.)
  • Experience building full-stack applications (Node.js, React, TypeScript)