Dremio logo

Senior Software Engineer - Query Engine

Dremio

Be Part of Building the Future

Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost.

About The Role

We are seeking a talented and motivated Senior Software Engineer to join our Datalake team within the Query Engine organization. In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats. This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem.

What You’ll Be Doing

  • Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format.
  • Optimizing file scan operations for various file formats, including Parquet, Avro, and others.
  • Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack.
  • Working with and contributing to open-source projects like Apache Iceberg, Parquet, and Arrow.
  • Maintaining and enhancing compliance with the Iceberg table format specification.
  • Conducting performance tuning and benchmarking to enhance query execution speed.
  • Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
  • Participating in code reviews and providing constructive feedback to peers.

What We’re Looking For

  • B.S., M.S. or PhD in Computer Science or in a related technical field.
  • 5+ years of software engineering experience, with a focus on database systems, query execution, or related fields.
  • Strong programming skills in an object-oriented language such as Java or C++.
  • Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems.
  • Familiarity with cloud object stores, such as AWS S3, ADLS, or GCS.
  • Experience with Apache Iceberg, Parquet, AVRO, and/or Delta.
  • Interested and motivated to be part of a fast-moving startup with a fun and accomplished team.
  • Desire to learn: You can stand your ground as well as be mentored by your teammates.

Bonus Points

  • Experience working with and contributing to open source projects.

What We Value

At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process.

Benefits
Extracted with AI

  • Equal opportunity employer
  • Workforce diversity
  • Accommodations for disabilities

Similar jobs

Last update: 23 minutes ago

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Software Development Engineer - Aurora Limitless Database

Join AWS as a Senior Software Development Engineer to innovate in cloud database services with Aurora Limitless Database.

Almedia logo
Almedia

Lead Data Engineer with GCP Expertise

Lead Data Engineer role in Berlin, focusing on GCP, BigQuery, and data pipelines.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

celver AG logo
celver AG

Senior Data Engineer

Join celver AG as a Senior Data Engineer to design and build Smart Data/Analytics platforms. Work with Python, SQL, and more in a dynamic environment.

Bot Auto logo
Bot Auto

Software Engineer - Data Platform

Join Bot Auto as a Software Engineer to design and evolve our hybrid-Cloud data platform. Work remotely with cutting-edge technology in autonomous trucking.

Zalando logo
Zalando

Data Engineer - Experimentation Platform

Join Zalando as a Data Engineer to enhance our Experimentation Platform with Python, SQL, and AWS skills.

Computer Futures logo
Computer Futures

Data Engineer

Join our team as a Data Engineer in Amsterdam, focusing on data pipelines, quality, and scaling using PySpark, Snowflake, Airflow, and AWS.

Microsoft logo
Microsoft

Senior Software Engineer - Cloud Streaming and Graphics

Join Microsoft as a Senior Software Engineer to develop cloud streaming technology for Mixed Reality.

Tangelo logo
Tangelo

Software Engineer - Back-End Java Developer

Join Tangelo as a Software Engineer to design and build scalable back-end systems in Java, working remotely with a focus on healthcare integration.

Offstream (YC S24) logo
Offstream (YC S24)

Backend Software Engineer

Join Offstream as a Backend Software Engineer focusing on AWS, Typescript, and GraphQL. Influence product architecture and development.

Microsoft logo
Microsoft

Remote Software Engineer - Data Mining and Analytics

Join Microsoft as a Remote Software Engineer focusing on data mining and analytics. Enhance developer productivity and security.

Glocomms logo
Glocomms

Software Engineer - Python, AWS, SQL

Join a healthtech startup as a Software Engineer in NYC, focusing on Python, AWS, and SQL. On-site role with competitive salary and benefits.

AllTrails logo
AllTrails

Software Engineer II, Backend (Remote)

Join AllTrails as a Software Engineer II, Backend, working remotely with Python, Django, and AWS to enhance our outdoor exploration platform.

avi logo
avi

Senior Backend Engineer with Python and Django

Join Avi Medical as a Senior Backend Engineer in Munich. Work with Python, Django, and cloud technologies to enhance patient care.

MongoDB logo
MongoDB

Staff Engineer, Cloud Provider Billing

Join MongoDB as a Staff Engineer in Cloud Provider Billing, focusing on distributed systems and cloud technologies.

Microsoft logo
Microsoft

Senior Software Engineer - C#, Java, SQL

Join Microsoft as a Senior Software Engineer in Prague, working with C#, Java, and SQL to innovate AI-first business applications.

Pipedrive logo
Pipedrive

ML Platform Engineer

Join Pipedrive as an ML Platform Engineer in Tallinn. Build and maintain ML platform components for Data Scientists and ML Engineers.

TheyDo - Journey Management logo
TheyDo - Journey Management

Senior Backend Engineer (Node.js)

Join TheyDo as a Senior Backend Engineer (Node.js) to shape scalable architectures and work on ambitious projects in a fully remote role.

Sentry logo
Sentry

Senior Software Engineer, Product Foundations (Backend)

Join Sentry as a Senior Software Engineer focusing on backend development with Python and Django in a hybrid role in San Francisco.

Reddit, Inc. logo
Reddit, Inc.

Backend Engineer - Ads Data Platform

Join Reddit as a Backend Engineer on the Ads Data Platform team, focusing on building and maintaining data infrastructure tools.

Aleph logo
Aleph

Frontend Engineer, AI

Join Aleph as a Frontend Engineer focusing on AI to develop innovative features using React.js and AI technologies in a remote role.

Within3 logo
Within3

Senior Python Backend Software Engineer

Join Within3 as a Senior Python Backend Software Engineer, leading data integration projects in a fully remote role.

Zip logo
Zip

Senior Software Engineer, Market Expansion

Join Zip as a Senior Software Engineer to build core products and architecture, focusing on market expansion.