Data Engineer II
| Company | Invisible Technologies |
|---|---|
| Location | San Francisco, CA, USA, New York, NY, USA |
| Salary | $109000 – $121000 |
| Type | Full-Time |
| Degrees | |
| Experience Level | Mid Level |
Requirements
- 3+ years of hands-on experience in software development and/or Big Data
- Excellent knowledge of Python
- Proficiency in PySpark and strong understanding of Spark
- Experience in building and maintaining Data Lakes or Data Warehouses (preferably Snowflake or Databricks)
- Strong understanding of ETL frameworks (e.g., dbt)
- Good knowledge of AWS (IAM, S3, and Security Groups)
- Familiarity with Infra-as-Code (Terraform or similar)
- Great communication skills: able to articulate status updates, blockers, and design considerations
- Ability and interest to travel up to 30% of the time for meetings with clients
Responsibilities
- Build, optimize, and maintain ETL pipelines
- Modify existing application code or interfaces, or develop new components
- Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance
- Develop and implement databases, data collection systems, and data analysis strategies for better efficiency and quality
- Conduct code and design reviews to maintain a high-quality product
- Mentor and guide Junior colleagues and new team members
- Collaborate with other Data Engineers and Forward deploy engineers and Platform engineers to prioritize business needs
- Share technical insights with the wider engineering teams
Preferred Qualifications
-
No preferred qualifications provided.