Staff Data Engineer

5-7+ years of experience writing Python & SQL
Must have 2-4+ years of experience with DBT
Proficiency in developing Apache Spark applications using PySpark (Databricks knowledge is a plus)
Proficiency in relational databases and data warehouses (Delta Lake knowledge is a plus)
Understanding and working experience with AWS
Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
Show proficiency understanding complex ETL processes.
Understanding of Risk and/or Fraud terminology
Knowledge of data integrity and relational rules.
Ability to quickly learn new technologies is critical.
Proficiency with agile or lean development practices.

Creating and maintaining optimal data pipelines.
Lead designing and implementing data pipelines required in the data warehouse and data lake in batch or real-time using data transformation technologies.
Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Lead designing and deploying data models and views with large datasets that meet functional / non-functional business requirements.
Lead delivering data integration solutions to downstream marketing and campaign software.
Lead delivering quality production-ready code in an agile environment.
Lead delivering test plans, monitoring, debugging and technical documents as a part of development cycle.
Lead creating data tools for analytics and working with stakeholders across all departments to assist with data-related technical issues and supporting their data infrastructure needs. Work closely with data architect and product manager to deliver such initiatives.
Drive engineering and operational excellence within their team.