Skip to contentData Services Architect
Company | Zeta Global |
---|
Location | San Francisco, CA, USA |
---|
Salary | $230000 – $250000 |
---|
Type | Full-Time |
---|
Degrees | |
---|
Experience Level | Expert or higher |
---|
Requirements
- 10+ years of experience in data architecture, big data platforms, and distributed computing.
- Expertise in Snowflake, Aerospike, ClickHouse, and Data Lake architectures.
- Strong hands-on experience with Hadoop ecosystem (HDFS, YARN, Spark, Hive, Presto, etc.).
- Proven experience with Kafka and real-time data streaming architectures.
- Deep understanding of cloud-based data infrastructure, preferably AWS.
- Proficiency in SQL, Python, Scala, or Java for data processing.
- Experience with containerization (Docker, Kubernetes) and infrastructure automation (Terraform, Ansible).
- Strong analytical and problem-solving skills.
- Excellent communication and leadership abilities.
- Experience with NoSQL databases (ScyllaDB, Cassandra, MongoDB).
Responsibilities
- Architect and lead the design, development, and operational management of Data Lake, Snowflake, Aerospike and other data store and processing environments.
- Ensure the scalability, performance, and reliability of big data processing frameworks such as Hadoop, Spark, and related technologies.
- Develop and manage real-time data streaming solutions using Kafka and other streaming platforms.
- Optimize and secure data pipelines for batch and streaming workloads.
- Define governance, security, and compliance standards for large-scale data infrastructure.
- Collaborate with development, DevOps, product and business teams to align data architecture with business objectives.
- Monitor, troubleshoot, and enhance system performance across all data platforms.
- Research and recommend emerging technologies in big data, cloud storage, and distributed systems.
Preferred Qualifications
No preferred qualifications provided.