Posted in

Senior Data Engineer – IDMC

Senior Data Engineer – IDMC

CompanyCentene
LocationMichigan, USA
Salary$85300 – $158100
TypeFull-Time
DegreesBachelor’s
Experience LevelMid Level, Senior

Requirements

  • A Bachelor’s degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science)
  • Requires 4 – 6 years of related experience
  • Proven expertise in IDMC and Snowflake
  • Knowledge of Python and Snowpark is advantageous
  • Strong understanding of cloud concepts related to AWS, Snowflake, and the Informatica IDMC platform

Responsibilities

  • Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics)
  • Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction
  • Manage and optimize data engineering processes focused on streaming data
  • Utilize IDMC and Snowflake for data warehousing tasks
  • Leverage Python and Snowpark for advanced data operations
  • Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics
  • Designs, develops, and maintains real-time processing applications and real-time data pipelines
  • Ensure quality of technical solutions as data moves across Centene’s environments
  • Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions
  • Develops, constructs, tests, and maintains architectures using advanced programming language and tools
  • Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated
  • Performs other duties as assigned
  • Complies with all policies and standards

Preferred Qualifications

  • Experience with Big Data; Data Processing
  • Experience with diagnosing system issues, engaging in data validation, and providing quality assurance testing
  • Experience with Data Manipulation; Data Mining
  • Experience working in a production cloud infrastructure