Sr. Software Engineer
| Company | OneMain Financial |
|---|---|
| Location | Charlotte, NC, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s |
| Experience Level | Mid Level, Senior |
Requirements
- 4+ years’ experience as a data engineer or relevant role
- Understanding of Big Data technologies
- Strong background in math, statistics, computer science, data science, or related discipline
- Good programming knowledge in Python
- Understanding of DataLake architecture and creating pipelines to ingest data into DataLake
- Experience in implementing data pipelines using AWS services, Docker/Kubernetes, and Airflow
- Proficient with different file formats: JSON, Avro, and Parquet
- Knowledge of one or more database technologies (e.g. PostgreSQL, Redshift, Snowflake, NoSQL databases)
- Proficiency in SQL queries
- Comfortable learning and deploying new technologies and tools
Responsibilities
- Create and manage cloud resources in AWS
- Develop infrastructure to collect, transform, combine, and publish/distribute customer data
- Data processing/transformation using technologies like Spark and Cloud Services
- Identify opportunities to optimize data collection, insights, and displays
- Ensure data and results are accessible, scalable, efficient, accurate, complete, and flexible
- Experiment with new technologies/patterns and conduct POCs
- Participate in regular Scrum ceremonies with agile teams
- Experience with source control and CI/CD pipelines
- Mentor junior members and implement industry best practices
Preferred Qualifications
- AWS certification
- Experience with Snowflake, DeltaLake, Kafka, AWS Glue, Terraform, Looker
- Familiarity with CI/CD tools like Jenkins, GitLab, Jira, Confluence