Join Agoda as a Lead Data Engineer – Hadoop Applications
About Agoda
Agoda is a leading online travel booking platform, connecting travelers with millions of accommodations worldwide. As part of Booking Holdings, Agoda is headquartered in Asia and employs over 7,000 professionals from more than 90 nationalities. We are committed to fostering a diverse and inclusive work environment that encourages creativity, collaboration, and innovation.
About the Role
As a Lead Data Engineer in the Hadoop Applications team, you will tackle some of the most challenging problems in the Hadoop ecosystem. You will focus on building user tools and applications for other teams, leveraging technologies like Apache Spark and Yarn. Your role will be crucial in driving a world-class data warehouse on top of Hadoop, providing tools to define data cubes and syncing high loads of data across systems.
Key Responsibilities
- Lead the team in enhancing the scalability, stability, accuracy, speed, and efficiency of our existing Data Platform.
- Build, administer, and scale the Data Platform using technologies such as S3, Kubernetes, KubeFlow, Spark, SQL, Impala, Scala, Java, and Python.
- Collaborate with experienced engineers to automate large-scale data platform management.
What You’ll Need to Succeed
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
- Over 6 years of experience in Data Platform Administration, including Hadoop, S3, AWS, and Google Cloud.
- Extensive experience in Kubernetes Administration in non-cloud platforms.
- Proficiency in Apache Spark performance tuning and debugging.
- Strong understanding of JVM and experience with Java or Scala.
- Experience with WorkFlow Schedulers like KubeFlow, AirFlow, or Oozie.
- SQL experience with tools like SparkSql, Impala, BigQuery, Presto/Trino, or StarRocks.
- Analytical problem-solving skills and experience in systems administration on Linux.
Preferred Qualifications
- Experience with open-source products.
- Python/Shell scripting skills.
- Experience working in an agile environment using test-driven methodologies.
Why Join Us?
- Be part of a team that is at the forefront of data engineering, solving complex challenges with cutting-edge technology.
- Work in a diverse and inclusive environment that values creativity and innovation.
- Enjoy opportunities for personal growth and career advancement.
Equal Opportunity Employer
Agoda is an equal opportunity employer. We are committed to providing equal employment opportunities regardless of sex, age, race, color, national origin, religion, marital status, pregnancy, sexual orientation, gender identity, disability, citizenship, veteran or military status, and other legally protected characteristics.
Join us in transforming travel for millions of customers worldwide. Apply now to be part of our dynamic team!
Benefits Extracted with AI
- Relocation assistance
- Diverse and inclusive work environment
- Opportunities for personal growth and success
Similar jobs
Last update: 23 minutes ago
Lead Full Stack Software Engineer
Lead Full Stack Software Engineer role in Amsterdam, focusing on React, GraphQL, and modern web technologies. Hybrid work environment.
Lead Full Stack Software Engineer
Lead Full Stack Software Engineer role in Hamburg, Germany. Requires expertise in React, TypeScript, and agile methodologies. Hybrid work environment.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Java Engineer with Angular and Spring Framework
Join Kadaster as a Java Engineer, working with Java, Spring, and Angular in a hybrid environment. Contribute to property information software.
Data Engineer with Azure and PySpark
Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.
Full Stack Software Engineer
Join Booking.com as a Full Stack Software Engineer in Amsterdam. Work on global e-commerce challenges with Java, JavaScript, React, and more.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Senior Software Engineer (Elasticsearch)
Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Backend Software Engineer
Join NCR Voyix as a Backend Software Engineer in Amsterdam. Design, build, and maintain scalable backend systems using Java, Node.js, and cloud platforms.
Senior Full Stack Engineer
Join PiNCAMP as a Senior Full Stack Engineer to build innovative camping solutions using Python, JavaScript, and cloud technologies.
Software Engineer with Haskell, Java, JavaScript, Python, C++
Join our innovative engineering team in Hamburg as a Software Engineer. Work with Haskell, Java, Python, and more in a hybrid environment.
Software Engineer - Cloud Applications and Python
Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.
Senior Python Engineer
Join TRACT as a Senior Python Engineer to develop scalable APIs and backend systems for sustainability insights in the Ag & Food industry.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Ghent. Work on ERP solutions for automotive finance and leasing.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Senior Java Software Developer
Join Conspect as a Senior Java Software Developer, working on diverse projects with Java, Spring, and more. Enjoy a great salary and benefits.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Lead Full Stack Developer
Lead Full Stack Developer role in Berlin, focusing on Angular, Java, and NoSQL for Deutsche Bank's Customer Administration Portal.
Full-Stack Software Engineer (Angular and Java)
Join WorkFlex as a Full-Stack Software Engineer specializing in Angular and Java. Work remotely and help build our next-gen platform.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.