Skip to content
Data Engineer – Pricing
| Company | Lyft |
|---|
| Location | Toronto, ON, Canada |
|---|
| Salary | $108000 – $135000 |
|---|
| Type | Full-Time |
|---|
| Degrees | Bachelor’s |
|---|
| Experience Level | Junior, Mid Level |
|---|
Requirements
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.
- 2+ years of relevant professional experience
- Strong experience with Spark
- Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
- Strong skills in a scripting language (Python, Ruby, Bash)
- Good understanding of SQL Engine and able to conduct advanced performance tuning
- Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
- Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
- Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering
Responsibilities
- Owner of the pricing data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
- Evolve data model and data schema based on business and engineering needs
- Implement systems tracking data quality and consistency
- Develop tools supporting self-service data pipeline management (ETL)
- SQL and MapReduce job tuning to improve data processing performance
- Write well-crafted, well-tested, readable, maintainable code
- Participate in code reviews to ensure code quality and distribute knowledge
- Unblock, support and communicate with internal & external partners to achieve results
Preferred Qualifications
No preferred qualifications provided.
