Tech Lead Data Engineer

Tech Lead Data Engineer

Description

About ByteDance
Founded in 2012, ByteDance’s mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us
Creation is the core of ByteDance’s purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.
Together, we inspire creativity and enrich life – a mission we aim towards achieving every day.
To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At ByteDance, we create together and grow together. That’s how we drive impact – for ourselves, our company, and the users we serve.
Join us.

About the Team
Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems – you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey!

Responsibilities
Provide technical guidance to Data Engineering team in designing, implementing, and maintaining reliable, scalable, robust, and extensible big data systems that will be used to make smarter business decisions to support business growth.
Craft optimal data processing architecture and systems for new data and ETL pipelines.
Analyze and improve real-time communication data pipeline quality, such as data optimize, service stabilities, and high availability.
Design, build, and maintain data transformations efficiently and reliably for designated purposes (e.g. reporting, growth analysis, multi-dimensional analysis).
Investigate and integrate emerging big data technologies into existing requirements.
Recommend different ways to constantly improve data reliability and quality.
Establish solid design and best engineering practice for engineers as well as non-technical people.
Define and drive mid/long term technical roadmap based on the key opportunities in business growth and industry technology trends.
Define and establish team’s tech stack and standards, drive for engineering excellence and best practices.
Work with product and business to define data strategy and drive for product based and scalable data solutions to empower business.

Qualifications
Must have a Master’s degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 3 years of related work experience; OR a Bachelor’s degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 6 years of post-bachelor’s, progressive related work experience.

Of the required experience, must have 3 years of experience in each of the following:
Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, or Python;
Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop;
Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports;
Performing code changes and reviews using Git version control and performing workflow management using JIRA; and
Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script.

Travel Requirement: Domestic and/or international travel up to 15% required.

Type: Full time, 40 hours/week
Location: San Jose, CA
Salary Range: $233958 – $410000 per year

To Apply, click the apply button below. Contact [email protected] if you have difficulty submitting resume through the website.

ByteDance Inc. is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Bytedance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at [email protected].

#LI-DNI

#IND-DNI

Benefits

Not Specified