Sr. Data Engineer - Data Engineering

Sr. Data Engineer – Data Engineering

Advanced OOP Python programming skills, particularly in data processing.
Experience with the SQLAlchemy ORM.
SQL database and schema design, management, and optimization expertise.
Hands-on experience with AWS services including S3, EC2, IAM, SFTP, Cloudwatch, and Lambda.
Familiarity with IaC technologies, such as Terraform.
Experience with time-series (TimescaleDB) and NoSQL databases (Elasticsearch).
Experience deploying and working with data analytics, dashboarding and visualization tools, such as Apache Superset, Grafana, Kibana.
Experience building RESTful APIs.
Proficiency in containerization technologies (Docker, Kubernetes).
Experience with Agile development methodologies and tools, including Jira and Git, and familiarity with industry-standard software development lifecycle processes.
Comfortable working independently and self-motivated to learn and excel in a fast-paced, innovative environment.

Develop and implement scalable end-to-end data pipelines using modern data processing and orchestration techniques, for both batch and streaming data.
Lead collaboration with data producers and data consumers to identify clear product requirements and structure an effective implementation of solutions, guiding the overhaul of pre-existing methods, when necessary.
Identify, evolve, and champion data/software engineering best practices and AI automations, as they best fit a small and agile team.
Automate infrastructure as code using Terraform.
Collaborate cross-functionally to define priorities, identify new projects, and establish effective partnerships to contribute to our data engineering roadmap.
Help envision and build the future of our data platform and data pipelines. You will have a remarkable impact on the overall tech stack we use to process the rich data available at Tenstorrent.

Familiarity with IaC, CI, monitoring, and documentation to achieve the highest levels of automation, quality, and functionality.