Intermediate Data Engineer
Company | MaintainX |
---|---|
Location | Montreal, QC, Canada |
Salary | $Not Provided – $Not Provided |
Type | Full-Time |
Degrees | |
Experience Level | Mid Level |
Requirements
- 3+ years of experience as a data engineer using Databricks
- Strong Python and SQL skills
- Experience with a cloud platform (We use AWS)
- Experience developing and monitoring ELT/ETL pipelines
- Experience working in an agile environment
Responsibilities
- Build, maintain, and scale data pipelines across several business pillars, including extract and load from third party APIs and databases from our products
- Model raw data into clean, reliable datasets that power both product features and internal analytics
- Improve observability, testing, and monitoring to ensure reliability and performance
- Manage data security, compliance and access
- Collaborate with engineering, machine learning, product, and analytics teams to support their data use cases
- Help establish platform foundations: CI/CD, documentation, best practices
Preferred Qualifications
- Experience with dbt, AWS DMS, Fivetran, and/or terraform
- Experience building CI/CD workflows for Databricks data pipelines (DABs, GitHub Actions, etc.)
- Experience in query optimization, resource allocation and management, cost management, and data lake performance
- Experience with cloud infrastructure (Kubernetes, Terraform, etc.)
- Experience with real-time or data-streaming pipelines
- Experience deploying and scaling ML solutions using open-source frameworks (MLFlow, etc.)
- Experience building full-stack applications (Node.js, React, TypeScript)