About the Role
Bloomberg is seeking a Senior Software Engineer to join the DataHub Engineering team, which provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse, and real-time stream processing capabilities. This platform serves as a single place within the company to discover, access, publish, and subscribe to data.
The DataHub team introduced the concept of a “dataset” and invented a schema language to formally define all data at Bloomberg, including schema evolution, versioning, and true point-in-time semantics. The team was the first to introduce technologies such as Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess, and Spark for ETL at Bloomberg.
Responsibilities
- Design, build, and maintain large clusters of Distributed Datastores composed of engines like MySQL/MyRocks scaled using Vitess to Petabytes of data with millisecond response on billions of reads and writes across hundreds of independent financial applications.
- Ensure platform reliability, observability, and efficiency.
- Customize Kubernetes clusters to meet specific needs.
Who You Are
- You have a strong curiosity, kindness, and an appetite to continually learn and share knowledge.
- You possess 4+ years of software engineering experience.
- You have experience with an object-oriented programming language, ideally Python or Golang.
- You have prior experience diagnosing failures in MySQL or related database engines and replication protocols.
- You have experience building reliable data infrastructure.
- A Degree in Computer Science, Engineering, Mathematics, or a similar field of study, or equivalent work experience is required.
We’d Love to See
- Contributions to open source projects related to Vitess, MySQL, RocksDB, or MyRocks.
- Vitess production experience.
- Experience building custom resource controllers and Kubernetes operators.
About Us
Meet the DataHub Engineering Team at Bloomberg and learn more about our innovative projects and the impact we make in the financial industry. Learn more about our team.
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer - MySQL Data Infrastructure
Senior Software Engineer for MySQL Data Infrastructure at Bloomberg in New York, NY. Expertise in Kubernetes, MySQL, Python needed.
Senior Software Engineer - Feeds Business Intelligence
Join Bloomberg as a Senior Software Engineer in Feeds Business Intelligence, focusing on real-time market data and full-stack development.
Senior Software Engineer - Cloud Native Compute Services
Join Bloomberg as a Senior Software Engineer in Cloud Native Compute Services, focusing on scalable compute and machine learning solutions.
Senior Software Engineer - Web Developer Experience
Join Bloomberg as a Senior Software Engineer to enhance web developer experience using Angular, React, and more.
Senior Software Engineer - API Platform
Join Bloomberg as a Senior Software Engineer on our API Platform team, focusing on high-quality APIs and user experience.
Senior Software Engineer/SRE - Kubernetes for Advanced Compute
Join Bloomberg as a Senior Software Engineer/SRE to innovate with Kubernetes and advanced compute solutions.
Senior Data Engineer - AI Group
Senior Data Engineer needed for AI Group at Bloomberg, NY. Expertise in Python, ETL, and big data technologies required.
Senior Software Engineer - Web Acquisition - Data Technologies
Senior Software Engineer for Web Acquisition in Data Technologies at Bloomberg, focusing on web scraping and full stack development.
Senior Software Engineering Team Leader - Apache Kafka Infrastructure
Lead Apache Kafka infrastructure projects at Bloomberg, utilizing Java, Scala, C++, Python, and Go. Senior role with competitive benefits.
Senior Software Engineer/SRE - Public Cloud Solutions
Join Bloomberg as a Senior Software Engineer/SRE to drive cloud adoption and build scalable solutions using Python, Terraform, and cloud platforms.
Senior Software Engineer
Join MongoDB as a Senior Software Engineer to lead and innovate in distributed systems and software development.
Senior Software Engineer - Infrastructure
Senior Software Engineer for Infrastructure at Baseten, specializing in cloud and ML operations, based in New York.
Senior Software Engineer - Data Pipeline Team
Senior Software Engineer for Data Pipeline team, remote work, expertise in Python, NoSQL, Big Data technologies.
Senior Software Engineer - Infrastructure Focus
Join Astronomer as a Senior Software Engineer focusing on infrastructure, working remotely with Kubernetes and Golang.
Senior LLM Engineer - Artificial Intelligence
Join Bloomberg as a Senior LLM Engineer to develop AI-driven solutions using Python and transformers.
Staff Database Engineer - AWS & MySQL
Lead Staff Database Engineer role focusing on AWS & MySQL in Amsterdam. Drive innovation and scalability in a high-transaction-rate environment.
Senior Software Engineer - Backend
Senior Backend Software Engineer role focusing on data analytics and cloud applications in New York, NY.
Senior Software Engineer, Developer Productivity
Join MongoDB as a Senior Software Engineer to enhance developer productivity with Python and MongoDB.
Software Engineer 2 - Database Engineer
Join Intuit as a Software Engineer 2 focusing on database engineering, MySQL, and AWS in Mountain View, CA.
Senior Database Engineer
Seeking a Senior Database Engineer with expertise in MySQL, MongoDB, and Linux for remote work.
Senior Software Engineer, Developer Productivity
Senior Software Engineer for Developer Productivity at MongoDB, enhancing engineering systems and processes.
Senior Software Engineer - Java/MongoDB
Senior Software Engineer role focusing on Java/MongoDB in Amsterdam. Involves developing software for global infrastructure management.
Senior Software Engineer - Kubernetes and Golang
Join MongoDB as a Senior Software Engineer to build and support Kubernetes tooling with Golang.
Senior Data Engineer, Data Platform - Ingestion
Join Bolt as a Senior Data Engineer focusing on data ingestion, optimizing our Data Platform using modern technologies.
