Engineer 4 – Data Engineering
| Company | Comcast |
|---|---|
| Location | Chicago, IL, USA, Reston, VA, USA |
| Salary | $118139.4 – $194086.16 |
| Type | Full-Time |
| Degrees | Bachelor’s |
| Experience Level | Senior, Expert or higher |
Requirements
- Bachelor’s Degree
- 7-10 Years of Relevant Work Experience
- Understanding of data sensitivity, customer data privacy rules and regulations
Responsibilities
- Develops data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs.
- Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.
- Creates standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.
- Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.
- Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.
- Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks.
- Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.
- Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes.
- Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.
- Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements.
- Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
- Develops strategies for data acquisition, archive recovery, and database implementation.
- Manages data migrations/conversions and troubleshooting data processing issues.
- Identifies and reacts to system notification and log to ensure quality standards for databases and applications.
Preferred Qualifications
- Some combination of coursework and experience, or extensive related professional experience.