Data Engineer - Insurance Data Services

Data Engineer – Insurance Data Services

working experience with Datalake, Spark, Scala, Hive Databases and SQL language
Working experience with ETL and reporting concept
Working knowledge of Windows environment
Working knowledge of Python/Spark/Shell scripting
IT Standards, Methodologies, SDLC, Information Security & audit requirements
Knowledge on creating formal written deliverables and other documentation and ensure design, code and documents are aligned with enterprise direction, principles and standards
Bachelors Degree in Computer Science

Performing analysis on structured, unstructured, and semi-structured raw data, utilizing programming skills to standardize and organize data Provides services on new initiatives of small to medium complexity
Supporting project team to scale, monitor and operate data platforms for a very high availability, high performing, and regulatory supporting application
Supports Big data, DataStage and IDP ETL, Web Focus/Tableau reports and extracts
Develops and supports Spark, Trino in support of Tableau reporting to Support Big Data on Cloudera platform
Monitor and act on incident tickets and service requests
Develops and supports Python, Spark, HQL and SQL jobs
Create IBM JCL and job scheduling documents as needed
Create production change records to deploy code for project or on behalf of other teams
Contributes to successful project completion by identifying risks and developing/recommending mitigation strategies
A team member, providing direction, expertise, feedback, coaching and development to build the capability of more junior staff
Continually enhances skills and builds knowledge on platform data technologies
May require off hour support, pager rotation