Lead/Data Architect

Lead/Data Architect

Requirements

• 7+ years professional experience in role as a hands-on data architect or similar role designing and implementing large-scale databases, infrastructure and data pipelines utilizing ETL and ELT techniques.
• 7+ years of proficiency in programming languages such as Python and experience with related frameworks and libraries (e.g., Apache Spark, Pandas, Apache Airflow)
• 7+ years of solid understanding and experience with data warehousing, data and dimensional modeling.
• 7+ years proficiency in SQL and experience in optimizing and tuning queries on OLTP and OLAP databases including Postgres, Oracle and Redshift.
• 4+ years of proven experience leading a team
• 4+ years of experience with cloud platforms and expertise with their data services and tools.
• Ability to clearly demonstrate effective business communication skills verbally and in writing to both internal and (external) stakeholders.
• Extensive experience architecting and designing OLTP and OLAP Databases
• Extensive experience implementing large-scale data infrastructure and ETL/ELT pipelines.
• Extensive experience applying best practice design patterns to structured and unstructured data at rest and during transport.
• Demonstrated ability to lead and mentor technical teams.

Responsibilities

• Develop technical architecture of OLTP and Enterprise BI/EDW datastores
• Design and implement scalable and efficient data infrastructure, including data pipeline, data ingestion, data storage including but not limited to customer data, product data, financial data, Google Analytics and operational data.
• Lead and mentor a team of data engineers, providing technical guidance and promoting best practices for data design and engineering.
• Develop and maintain data governance policies, ensuring data quality, security, and compliance with relevant regulations. Implement master data management to create a uniform and a standard set of attributes for core entities across the organization.
• Collaborate with cross-functional teams to identify and address data-related challenges, provide actionable business and analytical insights, and contribute to data-driven decision-making processes.
• Collaborate with business stakeholders, and software engineers to understand business requirements and translate them into technical solutions.
• Evaluate and select appropriate technologies, tools, and frameworks for scalability and performance.
• Drive continuous improvement initiatives, identify bottlenecks, and implement optimizations to enhance the efficiency and reliability of data pipelines and machine learning models and workflows.
• Lead code reviews and provide feedback on design and implementation.
• Troubleshoot & resolve production issues when they arise.
• Back up the department manager related to team tasks, reviewing team time in Jira, project status updates. Assign tasks and attend meetings related to new projects.
• Delegate tasks and ensure that tasks are completed efficiently and effectively.
• Partner with the department manager in building and executing data engineering roadmap and budgeting.
• Additional projects as needed
• Perform other duties and responsibilities as required, assigned, or requested. Consensus reserves the right to add or change duties at any time.

Preferred Qualifications

• Experience with AWS data services and tools.
• Experience implementing data sciences practice.
• Experience solving problems across multiple business domains like accounting, finance, marketing and sales etc for multiple businesses.
• Hands-on experience working as a DBA on OLTP and/or OLAP databases.
• Experience working with industry standard data modeling tools.
• Bachelor of Science degree in an Engineering discipline preferred.