About the Role
Bloomberg is seeking a Senior Software Engineer to join the DataHub Engineering team, which provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse, and real-time stream processing capabilities. This platform serves as a single point in the company to discover, access, publish, and subscribe to data.
The DataHub team introduced the concept of a “dataset” and invented a schema language to formally define all data at Bloomberg, including schema evolution, versioning, and true point-in-time semantics. The team was also the first to introduce technologies such as Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess, and Spark for ETL at Bloomberg.
Responsibilities
- Design, build, and maintain large clusters of Distributed Datastores composed of engines like MySQL/MyRocks scaled using Vitess to Petabytes of data with millisecond response on billions of reads and writes across hundreds of independent financial applications.
- Ensure platform reliability, observability, and efficiency.
- Customize Kubernetes clusters to meet the needs of the DataHub platform.
Who You Are
- You have at least 4 years of software engineering experience.
- You are proficient in an object-oriented programming language, ideally Python or Golang.
- You have prior experience diagnosing failures in MySQL or related database engines and replication protocols.
- You possess a degree in Computer Science, Engineering, Mathematics, or a similar field of study, or have equivalent work experience.
We’d Love to See
- Contributions to open source projects related to Vitess, MySQL, RocksDB, or MyRocks.
- Vitess production experience.
- Experience building custom resource controllers and Kubernetes operators.
About Us
Meet the DataHub Engineering Team at Bloomberg, a leader in business and financial information. Our technology solutions bring transparency, efficiency, and fairness to markets, connecting influential communities across the global financial ecosystem. Learn more about our team and projects here.
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer (Elasticsearch)
Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Software Engineer - Backend Development
Join Sysdig as a Senior Software Engineer to develop scalable backend services using Go, RESTful APIs, and microservices in a hybrid work environment.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Senior Backend Engineer (Java, Spring)
Join Moss as a Senior Backend Engineer in Berlin, focusing on Java, Spring, and microservices.
Senior Backend Developer (Node.js) / SRE
Join Binance as a Senior Backend Developer (Node.js) / SRE to develop monitoring systems for high-load production environments.
Software Engineer, Storage (Rust, PostgreSQL)
Join Neon as a Software Engineer, Storage. Work with Rust and PostgreSQL to build scalable, reliable cloud-native database services.
Staff Software Engineer: Data & Infrastructure Platforms - Metrics & Alerting
Join Uber's Amsterdam team as a Staff Software Engineer focusing on Data & Infrastructure Platforms, specializing in Metrics & Alerting.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Staff Software Engineer - Backend
Join Uber as a Staff Software Engineer - Backend to develop and enhance solutions for millions of members globally.
Staff Software Engineer - Backend
Join Uber as a Staff Software Engineer - Backend, focusing on membership systems. Work with Java, Python, C++, and more in Amsterdam.
Software Engineer - Backend - Membership
Join Uber as a Backend Software Engineer to develop member-first experiences in a collaborative team, impacting global foundations.
Senior API Platform Engineer
Join Brenntag as a Senior API Platform Engineer in Amsterdam to drive API platform development using Kubernetes, Istio, and AWS EKS.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Senior Software Engineer: Configuration Management/Deployment
Join Uber's Amsterdam team as a Senior Software Engineer focusing on configuration management and deployment. Solve infrastructure challenges at scale.
Senior Software Engineer - .NET and Go
Join Sysdig as a Senior Software Engineer in Berlin, focusing on .NET and Go for cloud security solutions.
Senior Data Engineer
Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.
Senior Software Engineer (Backend)
Join Bitvavo as a Senior Software Engineer (Backend) to drive innovation in crypto services using AWS, Kubernetes, and TypeScript.
Staff Software Engineer, Fullstack, Capacity & Efficiency Engineering
Join Uber as a Staff Software Engineer in Amsterdam, focusing on fullstack development and capacity efficiency engineering.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Ghent. Work on ERP solutions for automotive finance and leasing.
