About The Role
We seek a highly skilled and motivated Senior Software Engineer, specializing in Elasticsearch (ELK Stack), to join our Core Infrastructure team at Uber. Our sophisticated infrastructure spans both on-premise data centers and the cloud, supporting a diverse variety of workloads (stateless, batch, streaming), each different in its characteristics and requirements, that support our internal corporate use cases.
What You Will Do
- Work with the team to design, document, build, secure, and maintain Elasticsearch, Logstash, Kibana (ELK Stack) Enterprise solutions deployed with the ECK K8s operator to support non-production and production deployments.
- Collaborate closely with architects, engineers, and integrators to assess customer requirements and design and support an ELK Stack solution to ensure needs are met.
- Follow life-cycle processes to move solutions from Staging to Production.
- Maintain and develop Logstash pipelines to process numerous log sources.
- Install and configure an Elastic Cloud Kubernetes (ECK) solution in non-production and production environments, ensuring communication and integration among the Elasticsearch products and data sources.
- Document the installation and configuration for deployment into production.
- Secure the solution by being familiar with TLS, certificates, SSO/PIV authentication, and encryption technologies.
- Develop and apply quantitative and qualitative analytic methods to identify, collect, process, and analyze large data sets for specified purposes.
- Work with data lifecycle management.
- Test data flows, troubleshoot issues, and monitor the health of the solution and servers to maximize performance and minimize downtime.
- Serve as a trusted advisor, providing subject matter expertise, guidance, and best-practice recommendations.
Basic Qualifications
- Bachelor's/Master's degree in Computer Science or equivalent experience.
- Proficient in one of the following programming languages: Java, Go, C/C++, or similar languages. Good scripting skills and ability to pick up new ones.
- Systematic problem-solving approach and knowledge of algorithms, data structures, and complexity analysis.
- 5+ years of Elasticsearch stack (Elasticsearch, Logstash, Beats, Kibana) experience in production.
- Experience with data ingest, Extract, Transform, and Load (ETL) techniques, preferably with Logstash and Beats.
- Experience with multi-node clustering, architecture, development, implementation, and health monitoring of the indexes.
- Knowledge of hot/warm/cold data/index lifecycle management implementations.
- Knowledge of Elasticsearch Management, reindexing, and data mappings, JSON and KQL searching syntax, and Kibana dashboard options.
- Expertise in containerization with Docker/Kubernetes and orchestration tools Ansible/Puppet.
Bonus Qualifications
- Experience in architectures involving multiple microservices and their interaction with web services.
- Experience designing and implementing highly scalable, robust, and fault-tolerant services.
- Familiarity with observability tools such as Prometheus, Grafana, and the Elastic stack.
- GCP, AWS, and/or Kubernetes certifications are strongly preferred.
Similar jobs
Last update: 23 minutes ago
Software Engineer II - Developer Experience
Join Elastic as a Software Engineer II in Developer Experience, focusing on test frameworks for Kibana. Remote work, competitive benefits.
Senior Software Engineer - Capacity & Efficiency Engineering
Join Uber as a Senior Software Engineer in Amsterdam, focusing on capacity and efficiency engineering with skills in Python, Java, and distributed systems.
Senior Software Engineer - Platform CI
Join Uber as a Senior Software Engineer in Amsterdam to enhance our Developer Platform using AWS, Java, Python, and Docker.
Senior Software Engineer - Production Engineering
Join Uber as a Senior Software Engineer in Amsterdam, focusing on production engineering and reliability.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Ghent. Work on ERP solutions for automotive finance and leasing.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Software Engineer (Backend)
Join Bitvavo as a Senior Software Engineer (Backend) to drive innovation in crypto services using AWS, Kubernetes, and TypeScript.
Full Stack Software Engineer
Join Booking.com as a Full Stack Software Engineer in Amsterdam. Work on global e-commerce challenges with Java, JavaScript, React, and more.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Senior Full-Stack Engineer, Core Experiences
Join BetterUp as a Senior Full-Stack Engineer to lead projects, craft quality code, and empower teams in a hybrid role in the Netherlands.
Senior Software Engineer - Dispatching
Join as a Senior Software Engineer to lead dispatching services design, optimizing global networks with Go, Ruby, and React.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Senior Full-Stack Software Engineer (Finance Team)
Join Nedap as a Senior Full-Stack Software Engineer to enhance healthcare administration efficiency with Java and Vue.js expertise.
Senior Java Software Developer
Join Conspect as a Senior Java Software Developer, working on diverse projects with Java, Spring, and more. Enjoy a great salary and benefits.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Developer with Kubernetes and Automation Expertise
Join Swift as a Senior Developer to enhance our Kubernetes platform with automation and security expertise.
Senior Java Developer
Join Verum Artes as a Senior Java Developer in Amersfoort, working on critical tax applications in a scrum team. Hybrid work environment.
Senior Lead Fullstack Developer with Frontend Focus
Join NS as a Senior Lead Fullstack Developer focusing on frontend, working with Angular, AWS, and TypeScript in a dynamic e-commerce environment.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
Senior Backend Developer
Join Rentman as a Senior Backend Developer in Utrecht, Netherlands. Work with PHP, MySQL, and microservices in a dynamic, agile environment.
Full-Stack Software Engineer (Angular and Java)
Join WorkFlex as a Full-Stack Software Engineer specializing in Angular and Java. Work remotely and help build our next-gen platform.
