Staff Software Engineer – Data Acquisition & Observability

Staff Software Engineer – Data Acquisition & Observability

Requirements

• Bachelor’s Degree or higher in Computer Science, Engineering or other related technical field.
• 10+ years in software engineering, focusing on high performance data pipelines.
• Proficiency in Python and at least one compiled language (Rust, Go, C++).
• Experience with streaming/messaging platforms (Kafka, Pulsar, Flink, RabbitMQ).
• Strong background in real-time data pipelines and observability stacks (OpenTelemetry, Prometheus, Grafana, ELK).
• Deep knowledge of high-performance databases (time-series, document, object-store).
• Familiarity with API design (REST, gRPC, Protobuf, Avro).
• Experience with containerized workflows (Docker, Kubernetes).
• Able to work effectively across a number of different teams/functionalities.
• Excellent communication skills.

Responsibilities

• Architect document and implement a real-time data acquisition and observability framework, supporting logs, metrics, and traces.
• Develop high-throughput data pipelines for ingestion, transformation, and storage.
• Build API services and integrations for system monitoring and device communication.
• Optimize pipeline performance for low-latency, high-bandwidth environments.
• Collaborate with calibration and infrastructure engineers on deployment and data engineers on schema and reporting needs.
• Maintain monitoring, alerting, and visualization tools for system observability.
• Ensure security, compliance, and scalability across cloud and on-prem environments.
• Gather functional requirements from external stakeholders, refining them into technical requirements considering performance, scalability, and usability.
• Troubleshoot complex problems and incidents, working with cross-functional teams and end-users to identify root causes.

Preferred Qualifications

No preferred qualifications provided.