Senior Software Engineer - Cloud Native Compute Services

Job Overview

Bloomberg is seeking a Senior Software Engineer to join our Cloud Native Compute Services team. This role is pivotal in advancing our internal and enterprise compute and data science solutions, which support data-driven compute, machine learning, and business analytics. Our platforms, including the Data Science Platform and BQuant Platform, are designed to provide scalable compute, specialized hardware, and first-class support for workloads such as Spark, Trino, and Jupyter. These solutions leverage containerization, container orchestration, and cloud architecture.

Key Responsibilities

• Technical Leadership: Make key technical decisions to advance our compute solutions, focusing on creating a highly scaled and performant compute environment.
• Collaboration: Work closely with data engineers and machine learning experts to assess development flow and scale requirements.
• Problem Solving: Tackle complex challenges such as cluster federation, compute resource management, and public cloud integration.
• Observability: Build first-class observability in a cloud-native manner to provide necessary insights to users.
• Education and Mentorship: Educate users through tech talks, professional training, and documentation. Mentor junior engineers and contribute to Spark’s technical vision.

Required Skills and Experience

• Programming: 4+ years of experience with at least two object-oriented programming languages (Go, Python, Java) and a willingness to learn more.
• Education: A degree in Computer Science, Engineering, or a related field, or equivalent work experience.
• Kubernetes: Experience building and scaling container-based systems using Kubernetes.
• Data Analytics Frameworks: Experience with distributed data analytics frameworks such as Spark, Trino, Presto, and Kafka.
• Open Source: Ability to keep up with open source tech and trends for data analytics.
• Infrastructure: A passion for providing reliable and scalable enterprise-wide infrastructure.

Preferred Skills

• Kubernetes Operators: Experience with Kubebuilder and Kubernetes operator-based frameworks.
• Security Standards: Experience with platform security standards such as Spiffe and Spire.
• Machine Learning Frameworks: Experience with PyTorch, TensorFlow.
• Open Source Involvement: Contributions to open source projects or a well-curated blog.
• Cloud Experience: Operating production systems in public clouds like AWS, GCP, or Azure.
• Configuration Management: Experience with systems like Babka.
• Continuous Integration: Familiarity with tools like Jenkins, Git, and Chat-ops.

Why Join Us?

As a member of the Spark Engineering Team, you will have the opportunity to collaborate with engineers across Bloomberg and learn about the technology that delivers products from news to financial instruments. You will be part of a team that is deeply involved in open source communities, contributing back to projects and presenting at conferences.

If you are passionate about building resilient, highly available infrastructure and seamless, usable full-stack solutions, we would love to talk to you about joining our team.

Location

This position is based in New York, NY, United States.

Salary

The salary range for this position is €160,000 - €240,000 per year.

How to Apply

If this sounds like you, apply now!