Skip to content
Software Engineer – Data Platform
| Company | Benchling |
|---|
| Location | San Francisco, CA, USA |
|---|
| Salary | $165113 – $223388 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Senior |
|---|
Requirements
- Have 6+ years of experience or a proven track record in software engineering
- Experience with data processing technologies Kafka, Kinesis, Spark, Flink, or other open-source or commercial software
- Experience in schema design, SQL & Schema registry
- Experience in building and operating Search System like Elastic
- Strong experience with scripting language (such as Python)
- Experience with deployment and configuration management frameworks such as Terraform, Ansible, or Chef and container management systems such as Kubernetes or Amazon ECS.
- Driven by creating positive impact for our customers and Benchling’s business, and ultimately accelerating the pace of research in the Life Sciences
- Comfortable with complexity in the short term but can build towards simplicity in the long term
- Strong communicator with both words and data – you understand what it takes to go from raw data to something a human understands
Responsibilities
- Own projects end-to-end, from initial design, to prototype, to large-scale rollout.
- Build & operate high throughput distributed messaging platform like Kafka/kinesis to enable data change capture and data integration across Benchling.
- Define and design data transformations and pipelines for cross-functional datasets, while ensuring that data integrity and data privacy are first-class concerns regarded proactively, instead of reactively.
- Define the right Service Level Objectives for the batch & streaming pipelines, and optimize their performance.
- Designing and creating CI/CD pipelines for platform provisioning, full lifecycle management. Building the platform control panel to operate the fleet of systems efficiently.
- Work closely with the team across Application and Platform to establish best practices around usage of our data platform.
Preferred Qualifications
No preferred qualifications provided.
