Data Engineer

Data Engineer

Requirements

• Bachelor’s Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 2 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Responsibilities

• Develops integrated business and/or enterprise application solutions in data analytical space to ensure specifications are flexible, scalable, and maintainable and meet architectural standards.
• Develops software/data solutions for business requirements using a good understanding of programming fundamentals.
• Ensures good unit testing and functional testing coverage accounting for all boundary conditions according to the system integration test plan and supports user acceptance testing.
• Follows best source control and continuous integration/continuous deployment practices for efficient testing and deployment of code to different environments.
• Reviews technical documents, design, code, and demonstrations and performs peer reviews for design and code to stay aligned in team approach.
• Develops and participates in group design for data pipelines to move data between different operational systems, transactional systems, streaming systems, and big data systems (on-premises or cloud).
• Implements defined business metrics using a good understanding of structured query language (SQL), in collaboration with technical leads, data analysts, and product owners.
• Implements transformation logic to aggregate, filter, and combine multiple datasets to provide essential business consumable datasets and metrics.
• Analyzes and organizes data to determine data sets and metrics required to drive insights requested by the business.
• Helps develop, design, maintain, and enhance operational, analytical (including self-serve) applications across various business domains; delivers reports on-premises and cloud infrastructure; uses frameworks and reusable components whenever possible.
• Troubleshoots system issues, helps in root cause analysis, and drafts reports that provide insight into system support activities; ensures conformance of the technology solutions with IT governance and regulatory frameworks.
• Helps implement infrastructure-related projects for the organization.

Preferred Qualifications

• Master’s Degree in Computer Science, CIS, or related field
• 2 years of IT experience developing and implementing business systems within an organization
• 4 years of experience working with defect or incident tracking software
• 4 years of experience with technical documentation in a software development environment
• 2 years of experience working with an IT Infrastructure Library (ITIL) framework
• 2 years of experience leading teams, with or without direct reports
• Experience with application and integration middleware
• Experience with database technologies
• 2 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)
• Expertise in MicroStrategy/Power BI/SQL, Scripting, Teradata or equivalent RDBMS, Hadoop (OLAP on Hadoop), Dashboard development, Mobile development (specific to the BI Engineering role)
• 2 years of experience in Hadoop, NO-SQL, RDBMS or any Cloud Bigdata components, Teradata, MicroStrategy (specific to the Platform Engineering role)
• Expertise in Python, SQL, Scripting, Teradata, Hadoop utilities like Sqoop, Hive, Pig, Map Reduce, Spark, Ambari, Ranger, Kafka or equivalent Cloud Bigdata components (specific to the Platform Engineering role)