Skip to content
Senior Data Engineer
| Company | Progyny |
|---|
| Location | New York, NY, USA |
|---|
| Salary | $175000 – $185000 |
|---|
| Type | Full-Time |
|---|
| Degrees | Bachelor’s |
|---|
| Experience Level | Senior |
|---|
Requirements
- 5+ years of relevant experience building and maintaining production ETL pipelines and demonstrated understanding of different loading patterns and practices, with an ability to discuss tradeoffs between them
- Bachelor’s degree in Computer Science, Information Systems, or similar field of study
- 5+ years of consistent, professional SQL development experience
- 2+ years of Python development experience with focus on Data frame manipulation (preferably with Pandas or Polars)
- 3+ years of experience with well-known data pipeline/transform tools / platforms (DAG-based options like Dagster, Airflow, Prefect, etc.)
- Experience with data transformation models (ex: DBT)
- Experience with data access patterns (caching, partitioning, sharding)
- Familiarity with data modelling best practices / data structures
- Experience with data access optimization (ex: indexing)
Responsibilities
- Working with technology stakeholders to design and implement numerous data transformation pipelines, with a focus on all functional/non-functional quality goals
- Design and implementation of test, monitoring, and observability strategies for data systems and processes
- Support for outage incident response and return-to-service activities for data systems in your purview
- Supporting evaluation of related tools, frameworks and dev/test/deploy patterns as needed to evolve the platform capabilities for data support
Preferred Qualifications
- Working experience with data serialization models like Apache Arrow desirable
- Working experience with JSON-based storage models (example: FHIR) desired
- Strong communication skills
