Posted in

Lead Data Engineer

Lead Data Engineer

CompanyAmerican Red Cross
LocationRaleigh, NC, USA
Salary$140000 – $150000
TypeFull-Time
DegreesBachelor’s
Experience LevelExpert or higher

Requirements

  • 4-year college degree or equivalent combination of education and experience. Prefer academic backgrounds in Computer Science, Engineering, Mathematics, or related technical field.
  • 10 years of relevant work experience in data engineering, business intelligence or related field.
  • Experience with a variety of database technologies and data warehouse schema design patterns (snowflake and star in particular).
  • Experience with cloud-based databases, specifically AWS technologies (e.g., Redshift, RDS, S3, EC2, EKS, Zero ETL)
  • Experience using SQL queries as well as writing and optimizing SQL queries in a business environment with large-scale, complex datasets.
  • Experience creating ETL and/or ELT jobs.
  • Experience with Agile software development methodologies.
  • Excellent problem solving and troubleshooting skills.
  • Process oriented with great documentation skills.
  • Proficient in object-oriented programming (Python is a must).
  • Experience with DevOps methodologies and tools (e.g., Git, Artifactory, etc.).
  • Experience developing in a Linux environment.

Responsibilities

  • Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
  • Build and implement scalable solutions that align to our data governance standards and architectural roadmap for data integrations, data storage, reporting, and analytic solutions.
  • Design, develop and test data integration solutions. Write, automate and document unit/integration/functional tests.
  • Manage automated deployments using Git pipelines, ensuring code changes are efficiently version-controlled and deployed.
  • Collaborate with multiple teams to streamline deployment workflows, monitor and troubleshoot pipelines for reliability and performance.
  • Perform data analysis required to troubleshoot data-related issues by building a data quality framework and assist in the resolution of data issues.
  • Serve as tech lead by mentoring less experienced members of the team through code reviews, pair programming and similar hands-on interactions.

Preferred Qualifications

  • Experience developing integrations across multiple systems and APIs is a plus.
  • Experience with Big Data tools like Spark, Hadoop, Kafka, etc. is a plus.