Senior Data Engineer
| Company | Iron EagleX |
|---|---|
| Location | Alexandria, VA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | |
| Experience Level | Senior |
Requirements
- Python
- Regular Expression scripting
- SQL: Preference for PostgreSQL and TSQL.
- Git
- Docker
- Trino
- Familiarity with Kubernetes and Helm charts.
- Deploying software in Kubernetes with Argo.
- Airflow and Apache Spark
- ElasticSearch and AWS OpenSearch
- Working in a Linux environment.
- Database optimization
- Due to US Government Contract Requirements, only US Citizens are eligible for this role.
- An active TS/SCI security clearance is REQUIRED. Candidates without this clearance will not be considered.
Responsibilities
- Design, develop, and implement data pipelines and ETL processes using Python, Airflow, and Spark to support secure and efficient data processing.
- Develop scalable microservices for data handling and transformation, suitable for high-volume data ingestion and processing.
- Curate, cleanse, and secure data to support accurate and safe data transfers across multiple classification levels.
- Develop solutions to support both batch and streaming data processing.
- Integrate data pipelines with data lakes, warehouses, and databases, enhancing data accessibility and efficiency.
- Work collaboratively with cross-functional teams to deliver mission-critical data requirements.
- Ensure adherence to data handling best practices and compliance with security requirements when working with classified datasets.
- Employ data visualization techniques to make data more accessible and actionable for mission teams.
Preferred Qualifications
- Advanced degrees are a plus.