Staff Software Engineer / Data

Staff Software Engineer / Data

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, or related field OR demonstrable equivalent deep understanding, experience, and capability.
• Master or PhD degree in Computer Science (or related field) and 5+ years of experience in software engineering or 7+ years of experience in software engineering at a large scale.
• Very strong problem-solving skills, excellent communication and collaboration skills.
• Highly self-motivated and eager to learn.
• Rich experience in designing a simple, high quality, performed, and efficient solution for a large complex level problem.
• Rich experience and good understanding of CI/CD automation.
• Rich experience in combined engineering practice and agile development.
• Very rich experience and strong implementation skills using languages like Java, C#, Golang, & Python, including coding, automated testing, measurement and monitoring with a high productivity/throughput.
• Very experienced and with good understanding of data processing techniques, such as data pipeline/platform development, SQL, and DBs.
• Very experienced in data ingestion, cleaning, processing, enrichment, storage, serving, quality assurance techniques and tools, such as data pipeline development, SQL & relational algebra, DBs, ELT.
• Experienced in cloud technology, such as AWS and Azure.
• Good understanding of data warehousing and dimensional modeling, etc.

Responsibilities

• Collaborate with partners/stakeholders to learn about our customers’ business and key challenges.
• Design, test, code, and instrument new data products/systems/platforms/pipelines at large complexity level with simple and high quality solutions.
• Effectively measure, inspect, and drive decisions using data.
• Effectively develop and maintain CI/CD automation using tools such as GitHub Actions.
• Effectively implement Infrastructure as Code (IaC) using tools like Terraform, including provisioning and managing cloud-based data infrastructure.
• Effectively perform software development with TDD and BDD, Microservice and event-oriented Architectures with high efficiency, reliability, quality, and scalability.
• Support live data products/systems/platforms/pipelines, promote proactive monitoring including high data quality, rapid incident response, and continuous improvement.
• Effectively analyze data, existing systems and processes independently to effectively identify bottlenecks and opportunities for improvements.
• Mentor your peers, foster continuous learning of new technology within your team and organization.
• Attract high talents from industry to your team; help in interviews and provide quality and timely feedback.
• Role model at our team’s process and best practices, and apply them to given tasks with help from peers and your manager.
• Proactively understand customer/business problems you try to solve with these tasks, and ensure your design and implementation can actually solve these problems in an effective, reliable, and sustainable way.
• Partner with, assist, or lead your peers on completing complex tasks.
• Lead a scrum team in a hands-on way with proper agile development practices, and ensure the high quality and timely development and delivery that solve target problems effectively.
• Own large complex components or systems/products/platforms.
• Participate and lead technical discussions.
• Very efficiently design and build high quality and performed systems with craftsmanship.
• Independently & productively complete work at medium/large complexity level and proactively seek reviews from senior engineers on your work to ensure high quality.
• Proactively identify and communicate dependencies.
• Proactively review work from peers and provide constructive feedback/comments.
• Build reliable, secure, high quality, efficient, and easy to use big data platforms and tools at scale for supporting all kinds of data transferring, ingestion, processing, serving, delivery, consumption, and data governance needs.
• Build reliable, scalable, highly efficient and performed systems, platforms, data pipelines, and tools for E-2-E data life cycle, including data ingestion, cleaning, processing, enrichment, optimization, and serving by leveraging the Data platform.
• Use data modeling techniques to design/implement efficient and easy to use data models and structures.
• Become a deep subject matter expert in your functional area and best practices.
• Assess unique circumstances and apply creative problem-solving techniques to resolve issues or suggest various approaches.
• Use data and/or AI technology or tools in your design and development for high productivity and better solution quality. Influence your peers in this area.
• Lead initiatives for your team by using your wide-ranging experience and deep technical knowledge to make decisions on method and approach to solving issues.
• Hold yourself and your team accountable for delivering quality results using defined OKRs.
• Interact with Senior Managers to discuss plans, results, and advise on complex matters.

Preferred Qualifications

• Experience in building various architectures Datalakes, Data Lakehouse and Data warehouse.
• Extensive experience in data engineering, including data pipeline development, SQL, and database management. Proven ability to optimize data ingestion, transformation, and storage processes, ensuring scalable and efficient data flow for business-critical systems.
• Experience in Data Modelling using industry best practices for cloud based Datalakes, Data Lakehouse and Data Warehouses.
• Experience in implementing large scale Data LakeHouse, Data Warehouse with dimensional modeling techniques.