Agoda logo

Lead Data Engineer – Hadoop Applications

Agoda

Join Agoda as a Lead Data Engineer – Hadoop Applications

About Agoda

Agoda is a leading online travel booking platform, connecting travelers with millions of accommodations worldwide. As part of Booking Holdings, Agoda is headquartered in Asia and employs over 7,000 professionals from more than 90 nationalities. We are committed to fostering a diverse and inclusive work environment that encourages creativity, collaboration, and innovation.

About the Role

As a Lead Data Engineer in the Hadoop Applications team, you will tackle some of the most challenging problems in the Hadoop ecosystem. You will focus on building user tools and applications for other teams, leveraging technologies like Apache Spark and Yarn. Your role will be crucial in driving a world-class data warehouse on top of Hadoop, providing tools to define data cubes and syncing high loads of data across systems.

Key Responsibilities

  • Lead the team in enhancing the scalability, stability, accuracy, speed, and efficiency of our existing Data Platform.
  • Build, administer, and scale the Data Platform using technologies such as S3, Kubernetes, KubeFlow, Spark, SQL, Impala, Scala, Java, and Python.
  • Collaborate with experienced engineers to automate large-scale data platform management.

What You’ll Need to Succeed

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
  • Over 6 years of experience in Data Platform Administration, including Hadoop, S3, AWS, and Google Cloud.
  • Extensive experience in Kubernetes Administration in non-cloud platforms.
  • Proficiency in Apache Spark performance tuning and debugging.
  • Strong understanding of JVM and experience with Java or Scala.
  • Experience with WorkFlow Schedulers like KubeFlow, AirFlow, or Oozie.
  • SQL experience with tools like SparkSql, Impala, BigQuery, Presto/Trino, or StarRocks.
  • Analytical problem-solving skills and experience in systems administration on Linux.

Preferred Qualifications

  • Experience with open-source products.
  • Python/Shell scripting skills.
  • Experience working in an agile environment using test-driven methodologies.

Why Join Us?

  • Be part of a team that is at the forefront of data engineering, solving complex challenges with cutting-edge technology.
  • Work in a diverse and inclusive environment that values creativity and innovation.
  • Enjoy opportunities for personal growth and career advancement.

Equal Opportunity Employer

Agoda is an equal opportunity employer. We are committed to providing equal employment opportunities regardless of sex, age, race, color, national origin, religion, marital status, pregnancy, sexual orientation, gender identity, disability, citizenship, veteran or military status, and other legally protected characteristics.

Join us in transforming travel for millions of customers worldwide. Apply now to be part of our dynamic team!

Benefits
Extracted with AI

  • Relocation assistance
  • Diverse and inclusive work environment
  • Opportunities for personal growth and success

Similar jobs

Last update: 23 minutes ago

Agoda logo
Agoda

Lead Full Stack Software Engineer

Lead Full Stack Software Engineer role in Amsterdam, focusing on React, GraphQL, and modern web technologies. Hybrid work environment.

Agoda logo
Agoda

Lead Full Stack Software Engineer

Lead Full Stack Software Engineer role in Hamburg, Germany. Requires expertise in React, TypeScript, and agile methodologies. Hybrid work environment.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

Kadaster logo
Kadaster

Java Engineer with Angular and Spring Framework

Join Kadaster as a Java Engineer, working with Java, Spring, and Angular in a hybrid environment. Contribute to property information software.

BeFrank logo
BeFrank

Data Engineer with Azure and PySpark

Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.

Booking.com logo
Booking.com

Full Stack Software Engineer

Join Booking.com as a Full Stack Software Engineer in Amsterdam. Work on global e-commerce challenges with Java, JavaScript, React, and more.

Personio logo
Personio

Staff Software Engineer, Data Platform

Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

Uber logo
Uber

Senior Software Engineer (Elasticsearch)

Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.

Aiven logo
Aiven

Senior Software Engineer - Python, Apache Kafka

Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

NCR Voyix logo
NCR Voyix

Backend Software Engineer

Join NCR Voyix as a Backend Software Engineer in Amsterdam. Design, build, and maintain scalable backend systems using Java, Node.js, and cloud platforms.

PiNCAMP logo
PiNCAMP

Senior Full Stack Engineer

Join PiNCAMP as a Senior Full Stack Engineer to build innovative camping solutions using Python, JavaScript, and cloud technologies.

freiheit.com technologies logo
freiheit.com technologies

Software Engineer with Haskell, Java, JavaScript, Python, C++

Join our innovative engineering team in Hamburg as a Software Engineer. Work with Haskell, Java, Python, and more in a hybrid environment.

Topicus logo
Topicus

Software Engineer - Cloud Applications and Python

Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.

TRACT  logo
TRACT

Senior Python Engineer

Join TRACT as a Senior Python Engineer to develop scalable APIs and backend systems for sustainability insights in the Ag & Food industry.

Sofico logo
Sofico

Senior Software Engineer - Java, Microservices

Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Ghent. Work on ERP solutions for automotive finance and leasing.

HeyJobs logo
HeyJobs

Senior Software Engineer - AWS, Python, Ruby on Rails

Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.

Nubank logo
Nubank

Senior Software Engineer - Data Platform

Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.

Conspect logo
Conspect

Senior Java Software Developer

Join Conspect as a Senior Java Software Developer, working on diverse projects with Java, Spring, and more. Enjoy a great salary and benefits.

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

Deutsche Bank logo
Deutsche Bank

Lead Full Stack Developer

Lead Full Stack Developer role in Berlin, focusing on Angular, Java, and NoSQL for Deutsche Bank's Customer Administration Portal.

WorkFlex logo
WorkFlex

Full-Stack Software Engineer (Angular and Java)

Join WorkFlex as a Full-Stack Software Engineer specializing in Angular and Java. Work remotely and help build our next-gen platform.

Nebius AI logo
Nebius AI

Senior Backend Engineer (Go)

Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.