Posted in

Data Services Architect

Data Services Architect

CompanyZeta Global
LocationSan Francisco, CA, USA
Salary$230000 – $250000
TypeFull-Time
Degrees
Experience LevelExpert or higher

Requirements

  • 10+ years of experience in data architecture, big data platforms, and distributed computing.
  • Expertise in Snowflake, Aerospike, ClickHouse, and Data Lake architectures.
  • Strong hands-on experience with Hadoop ecosystem (HDFS, YARN, Spark, Hive, Presto, etc.).
  • Proven experience with Kafka and real-time data streaming architectures.
  • Deep understanding of cloud-based data infrastructure, preferably AWS.
  • Proficiency in SQL, Python, Scala, or Java for data processing.
  • Experience with containerization (Docker, Kubernetes) and infrastructure automation (Terraform, Ansible).
  • Strong analytical and problem-solving skills.
  • Excellent communication and leadership abilities.
  • Experience with NoSQL databases (ScyllaDB, Cassandra, MongoDB).

Responsibilities

  • Architect and lead the design, development, and operational management of Data Lake, Snowflake, Aerospike and other data store and processing environments.
  • Ensure the scalability, performance, and reliability of big data processing frameworks such as Hadoop, Spark, and related technologies.
  • Develop and manage real-time data streaming solutions using Kafka and other streaming platforms.
  • Optimize and secure data pipelines for batch and streaming workloads.
  • Define governance, security, and compliance standards for large-scale data infrastructure.
  • Collaborate with development, DevOps, product and business teams to align data architecture with business objectives.
  • Monitor, troubleshoot, and enhance system performance across all data platforms.
  • Research and recommend emerging technologies in big data, cloud storage, and distributed systems.

Preferred Qualifications

    No preferred qualifications provided.