Posted in

Senior Data Engineer

Senior Data Engineer

CompanyCaterpillar Inc.
LocationPeoria, IL, USA, Chicago, IL, USA, Irving, TX, USA
Salary$110520 – $179640
TypeFull-Time
Degrees
Experience LevelSenior

Requirements

  • Knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements.
  • Knowledge of software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.
  • Knowledge of software product design; ability to convert market requirements into the software product design.
  • Knowledge of technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.
  • Knowledge of software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.

Responsibilities

  • Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
  • Works directly on complex application/technical problem identification and resolution.
  • Support the development of programs leveraging AI and related cutting-edge technologies.
  • Interpreting design requirements for engineering implementation.
  • Building and deploying CICD pipelines.
  • Implementing source to target mapping as pipeline code.
  • Responsibility for Unit and Integration testing.
  • Maintains high standards of software quality within the team by establishing good practices and habits.
  • Identifies and encourage areas for growth and improvement within the team.
  • Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

Preferred Qualifications

  • Software development experience and solid working knowledge of OOP principles.
  • Experience in designing and developing software applications in Python.
  • Experience working with Git version control on medium to large teams. Proficient in leveraging Github copilot for work efficiency.
  • Exceptional communication skills with experience working on a cross functional team.
  • Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.
  • Experience with AWS components such as Lambda, Dynamo, Fargate, S3, Sagemaker, IAM and RDS.
  • Experience working with Snowflake and able to write efficient SQL queries.
  • Knowledge and experience with AI technologies such as LLM, RAG, LangChain frameworks, etc is a plus.
  • Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends.
  • Technical writing skills.