Skip to content

Staff Data Engineer
Company | FanDuel |
---|
Location | New York, NY, USA |
---|
Salary | $158000 – $208000 |
---|
Type | Full-Time |
---|
Degrees | |
---|
Experience Level | Senior |
---|
Requirements
- 5-7+ years of experience writing Python & SQL
- Must have 2-4+ years of experience with DBT
- Proficiency in developing Apache Spark applications using PySpark (Databricks knowledge is a plus)
- Proficiency in relational databases and data warehouses (Delta Lake knowledge is a plus)
- Understanding and working experience with AWS
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Show proficiency understanding complex ETL processes.
- Understanding of Risk and/or Fraud terminology
- Knowledge of data integrity and relational rules.
- Ability to quickly learn new technologies is critical.
- Proficiency with agile or lean development practices.
Responsibilities
- Creating and maintaining optimal data pipelines.
- Lead designing and implementing data pipelines required in the data warehouse and data lake in batch or real-time using data transformation technologies.
- Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
- Lead designing and deploying data models and views with large datasets that meet functional / non-functional business requirements.
- Lead delivering data integration solutions to downstream marketing and campaign software.
- Lead delivering quality production-ready code in an agile environment.
- Lead delivering test plans, monitoring, debugging and technical documents as a part of development cycle.
- Lead creating data tools for analytics and working with stakeholders across all departments to assist with data-related technical issues and supporting their data infrastructure needs. Work closely with data architect and product manager to deliver such initiatives.
- Drive engineering and operational excellence within their team.
Preferred Qualifications
No preferred qualifications provided.