Data Engineer / Integration Specialist
Company | City of Philadelphia |
---|---|
Location | Philadelphia, PA, USA |
Salary | $Not Provided – $Not Provided |
Type | Full-Time |
Degrees | Bachelor’s |
Experience Level | Junior, Mid Level |
Requirements
- Proficient in Python
- Strong SQL skills and experience with databases (Postgres preferred)
- Familiarity with Docker, bash and minimal Linux server administration
- Experience with cloud services (AWS preferred)
- Understanding of Git/GitHub for version control and CI/CD pipelines
- Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft
- Experience working with spatial datasets a plus
- Experience using command line interfaces
- Bachelor’s degree in Computer Science, Information Systems, or a related field
- Demonstrated experience in data engineering or a similar role, with a focus on data management/integration/ETL/ELT
- Proven track record with Python, SQL, and database management
- Experience with working with modern data engineering tech stack
- Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies
Responsibilities
- Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility
- Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance
- Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City’s DataBridge, Databridge-Airflow and AIS
- Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders
Preferred Qualifications
- Previous work in a public sector or large organization setting is a plus