Posted in

Data Engineer / Integration Specialist

Data Engineer / Integration Specialist

CompanyCity of Philadelphia
LocationPhiladelphia, PA, USA
Salary$Not Provided – $Not Provided
TypeFull-Time
DegreesBachelor’s
Experience LevelJunior, Mid Level

Requirements

  • Proficient in Python
  • Strong SQL skills and experience with databases (Postgres preferred)
  • Familiarity with Docker, bash and minimal Linux server administration
  • Experience with cloud services (AWS preferred)
  • Understanding of Git/GitHub for version control and CI/CD pipelines
  • Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft
  • Experience working with spatial datasets a plus
  • Experience using command line interfaces
  • Bachelor’s degree in Computer Science, Information Systems, or a related field
  • Demonstrated experience in data engineering or a similar role, with a focus on data management/integration/ETL/ELT
  • Proven track record with Python, SQL, and database management
  • Experience with working with modern data engineering tech stack
  • Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies

Responsibilities

  • Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility
  • Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance
  • Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City’s DataBridge, Databridge-Airflow and AIS
  • Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders

Preferred Qualifications

  • Previous work in a public sector or large organization setting is a plus