Data Engineering Senior Manager – Generative AI
Company | American International Group |
---|---|
Location | Atlanta, GA, USA |
Salary | $Not Provided – $Not Provided |
Type | Full-Time |
Degrees | |
Experience Level | Senior |
Requirements
- significant experience in data engineering, programming, and delivering scalable data solutions in complex environments
- highly skilled in programming languages such as PySpark, Python, Spark SQL, Java, JavaScript, and TypeScript
- proficient in cloud-native platforms and tools, including Spark, Kubernetes, and ElasticSearch
- experienced with CICD and code versioning capabilities such as Github and Jenkins
- experience developing in latest cloud native platforms (AWS, Azure, GCP)
- strong background in deploying and maintaining AI/ML models, with hands-on experience using platforms like Palantir Foundry, Snowflake, and AWS SageMaker
- experience setting up E2E Engineering pipeline, monitoring, and troubleshooting
- ELT/ETL experience with working knowledge in informatica
Responsibilities
- Collaborating with stakeholders to identify and deliver innovative data solutions that meet the evolving needs of the business
- Building and maintaining cloud-native big data solutions, advanced analytics products and GenAI models
- Partnering with data architects and senior engineers to implement best practices, ensuring sustainable and scalable technical designs
- Working closely with analytics, application development, and data science teams to foster collaboration and drive innovation
- Managing project timelines and deliverables, ensuring high-quality results on fast-paced schedules while maintaining rigorous standards for development and code management
Preferred Qualifications
- passionate about exploring innovative AI and Generative AI technologies, using them to drive impactful solutions within large-scale enterprise environments
- experience working with both internal and external teams to deliver best-in-class data engineering solutions, sharing knowledge and best practices across the organization
- enjoy working within the financial services or insurance industry and understand the unique data challenges these sectors face
- experienced in implementing code versioning processes and are committed to maintaining high standards for software development and project management