About the Role
Bloomberg is seeking a Senior Software Engineer to join the DataHub Engineering team, which provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse, and real-time stream processing capabilities. This platform serves as a single place within the company to discover, access, publish, and subscribe to data.
The DataHub team introduced the concept of a “dataset” and invented a schema language to formally define all data at Bloomberg, including schema evolution, versioning, and true point-in-time semantics. The team was the first to introduce technologies such as Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess, and Spark for ETL at Bloomberg.
Responsibilities
- Design, build, and maintain large clusters of Distributed Datastores composed of engines like MySQL/MyRocks scaled using Vitess to Petabytes of data with millisecond response on billions of reads and writes across hundreds of independent financial applications.
- Ensure platform reliability, observability, and efficiency.
- Customize Kubernetes clusters to meet specific needs.
Who You Are
- You have a strong curiosity, kindness, and an appetite to continually learn and share knowledge.
- You possess 4+ years of software engineering experience.
- You have experience with an object-oriented programming language, ideally Python or Golang.
- You have prior experience diagnosing failures in MySQL or related database engines and replication protocols.
- You have experience building reliable data infrastructure.
- A Degree in Computer Science, Engineering, Mathematics, or a similar field of study, or equivalent work experience is required.
We’d Love to See
- Contributions to open source projects related to Vitess, MySQL, RocksDB, or MyRocks.
- Vitess production experience.
- Experience building custom resource controllers and Kubernetes operators.
About Us
Meet the DataHub Engineering Team at Bloomberg and learn more about our innovative projects and the impact we make in the financial industry. Learn more about our team.
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer (Elasticsearch)
Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.
Senior Software Engineer - Backend Development
Join Sysdig as a Senior Software Engineer to develop scalable backend services using Go, RESTful APIs, and microservices in a hybrid work environment.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Ghent. Work on ERP solutions for automotive finance and leasing.
Senior FullStack Developer (React, Node.js, TypeScript)
Join Bloom as a Senior FullStack Developer to enhance our platform using React, Node.js, and TypeScript in a dynamic, hybrid work environment.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Senior Software Engineer (Backend)
Join Bitvavo as a Senior Software Engineer (Backend) to drive innovation in crypto services using AWS, Kubernetes, and TypeScript.
Senior Software Engineer (Java, MQTT, MongoDB)
Join HiveMQ as a Senior Software Engineer to design and develop scalable MQTT software systems. Work remotely with a diverse team.
Senior Full Stack Engineer
Join Bolt as a Senior Full Stack Engineer to work on complex algorithms, backend and frontend systems using Node.js and TypeScript.
Senior Developer with Kubernetes and Automation Expertise
Join Swift as a Senior Developer to enhance our Kubernetes platform with automation and security expertise.
Senior Software Engineer - .NET and Go
Join Sysdig as a Senior Software Engineer in Berlin, focusing on .NET and Go for cloud security solutions.
Senior NodeJS Developer
Join Semrush as a Senior NodeJS Developer to build and enhance digital marketing tools. Work remotely with flexible hours.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior C++ Software Engineer
Join Bitmovin as a Senior C++ Software Engineer to develop scalable video streaming solutions using modern C++ and cloud-native architectures.
Senior Backend Engineer - Data Gateway (Kotlin, Spring, AWS)
Join Bettermile as a Senior Backend Engineer to develop Data Gateway components using Kotlin, Spring, and AWS in a hybrid work environment.
Senior Full Stack Engineer
Join PiNCAMP as a Senior Full Stack Engineer to build innovative camping solutions using Python, JavaScript, and cloud technologies.
Senior Software Engineer - Feeds Business Intelligence
Join Bloomberg as a Senior Software Engineer in Feeds Business Intelligence, focusing on real-time market data and full-stack development.
Backend Software Engineer
Join NCR Voyix as a Backend Software Engineer in Amsterdam. Design, build, and maintain scalable backend systems using Java, Node.js, and cloud platforms.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
