Tech Lead, Data Engine
TikTokWhy Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day. To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
Team Introduction
The Data Engine team horizontally supports various core business lines within TikTok, as well as external enterprise customers through Volcano Engine. It focuses on solving big data architecture challenges for a 10EB level data set to create an industry-leading big data infrastructure. In addition, the team provides cloud-native real-time data lake and data warehouse services to business customers through its LAS (LakeHouse Analytics Service) product.
Responsibilities
- Build the industry-leading 10 EB-level big data platform that supports core products and businesses
- Optimize and enhance big data system kernels, Spark SQL, Presto, Flink, Hive, HUDI etc.
- Build the long-term competitive advantage of the data engine
Qualifications
- Familiar with principles and source code of one or more mainstream big data systems such as Spark, Presto, Flink hive and HUDI
- Familiar with data lake technologies including Iceberg, HUDI and DeltaLake
- Ability to diagnose failures and optimize performance in large-scale systems
- Committers in major database projects (Spark, Flink, HUDI, Iceberg, Presto, StarRocks, Kafka, Calcite, etc) preferred
- Experience in leading large-scale engine projects is a plus
Benefits Extracted with AI
- Medical insurance
- Disability insurance
- 401(k)
Similar jobs
Last update: 23 minutes ago
Operations Data Analyst - Trust and Safety
Join TikTok as an Operations Data Analyst in Trust and Safety, leveraging data analytics and visualization skills.
Front Software Engineer, TikTok Open Platform
Join TikTok as a Front Software Engineer to build and optimize front-end solutions for a global platform.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok. Work with Kubernetes, Spark, and cloud technologies. Relocation provided.
Senior Data Engineer - Fintech Team
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Lead data system improvements using Java, Scala, and Spark.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok. Enhance scalability and efficiency using Kubernetes, Spark, and cloud technologies.
Senior Data Engineer - Fintech Team
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Enhance data systems with Java, Scala, and Spark. Relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on Kubernetes, Apache Spark, and cloud technologies. Relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on scalability and efficiency using Kubernetes, Spark, and cloud technologies.
Data Scientist II, Growth
Join Tinder's Growth Data Science team as a Data Scientist II to drive data-informed decision-making and business solutions.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with Scala, Spark, Java, and more. Relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, expertise in Kubernetes, Spark, and Hadoop required. Relocation provided.
Senior ML Infrastructure Engineer
Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with Scala, Spark, Java, and more. Relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on scalability and efficiency using Kubernetes, Spark, and more.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok. Work with Kubernetes, Spark, and Hadoop to scale Agoda's data infrastructure.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, expertise in Kubernetes, Spark, and cloud technologies, relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok. Enhance scalability and efficiency using Kubernetes, Spark, and more.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on scalability, stability, and efficiency. Relocation provided.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Lead data systems, enhance scalability, and drive fintech innovation.
Data Scientist
Join Twitch as a Data Scientist to drive insights and analytics in a remote role. Leverage SQL, Python, and data visualization skills.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Berlin. Work with Java, Scala, and Big Data technologies to enhance data systems.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on Kubernetes, Apache Spark, and Hadoop. Relocation provided.
Lead DevOps Engineer – Data Platform
Lead DevOps Engineer for Data Platform in Bangkok, focusing on scalability and efficiency using Kubernetes, Spark, and more.
Senior Data Engineer (Fintech)
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology and innovative projects. Relocation provided.