Senior Data Engineer
| Company | Doran Jones Inc. |
|---|---|
| Location | Tampa, FL, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s |
| Experience Level | Senior |
Requirements
- 6+ years of experience in implementing data-intensive solutions using agile methodologies.
- Proficient in one or more programming languages commonly used in data engineering, such as Python, Java, or Scala.
- 6+ years of experience with software engineering best practices (unit testing, automation, design patterns, peer review, etc.).
- 4+ years of experience with Hadoop for data storage and processing is valuable, as is exposure to modern data platforms such as Snowflake and Databricks.
- 4+ years of experience with Cloud-native development and Container Orchestration tools (Serverless, Docker, Kubernetes, OpenShift, etc.).
- 4+ years of experience with open-source data engineering tools and frameworks (e.g., Spark, Kafka, Beam, Flink, Trino, Airflow, DBT)
- Exposure to various table and file formats, including Iceberg, Hive, Avro, Parquet, and JSON.
- Experience architecting and building horizontally scalable, highly available, highly resilient, and low latency applications.
- Strong proficiency in working with relational databases and using SQL for data querying, transformation, and manipulation.
- Clear understanding of Data Structures and Object Oriented Principles.
- Experience in modeling data for analytical consumers.
- Ability to automate and streamline the build, test, and deployment of data pipelines.
- Proven experience in providing technical vision and guidance to a data team.
- Excels in a fast-paced environment, effectively managing multiple tasks while upholding high work standards.
- Bachelor’s degree in Computer Science, MIS, or a related field.
Responsibilities
- Code contributing member of an Agile team, working to deliver sprint goals.
- Demonstrate technical knowledge and expertise in software development, including programming languages, frameworks, and best practices.
- Actively contributes to the implementation of features and technical solutions. Write clean, efficient, and maintainable code that meets the highest quality standards.
- Collaborate with other Engineers to define and evolve the overall system architecture and design.
- Provide guidance on scalable, robust, and efficient solutions that align with business requirements and industry best practices.
- Offer expert engineering guidance and support to multiple teams, helping them overcome technical challenges, make informed decisions, and deliver high-quality software solutions.
- Foster a culture of technical excellence and continuous improvement.
- Stay current with emerging technologies, tools, and industry trends. Evaluate their potential impact on the organization and provide recommendations for technology adoption and innovation.
Preferred Qualifications
- Experience with Data Transformation tools like Ab Initio is a plus. Appreciation of data parallelism, associated partitioning strategies, and understanding of key components in the GDE is particularly relevant.
- Experience in cloud native technologies and patterns (AWS, Google Cloud)
- Exposure to Infrastructure as Code tools (i.e., Terraform, Cloudformation, etc.)
- Experience in driving and/or influencing the data strategy of your team or organization.