Senior GCP Data Engineer (Databricks)

About the Role

We are seeking a Senior GCP Data Engineer (Databricks) to join our team at Xebia Poland. This role is perfect for someone who is passionate about cloud-based solutions and has a strong background in data engineering and backend development. You will be responsible for designing, building, and deploying scalable infrastructure with a focus on distributed systems. Your work will involve creating architecture patterns for data processing, workflow definitions, and system integrations using Big Data and Cloud technologies.

Key Responsibilities

Design, build, and deploy at-scale infrastructure with a focus on distributed systems.
Develop and maintain architecture patterns for data processing and system integrations.
Evaluate and translate technical designs into workable solutions and technical specifications.
Drive the creation of reusable artifacts and establish automated processes for data analysis and model development.
Collaborate with analysts and data scientists to understand the impact on downstream data models.
Write efficient and well-organized software to ship products in an iterative release environment.
Promote good software engineering practices across the team.
Communicate effectively with both technical and non-technical audiences.
Define data retention policies and monitor performance to advise on necessary infrastructure changes.

Your Profile

3+ years of experience with GCP (BigQuery, Dataflow, Pub/Sub, Bigtable, Dataproc, Storage, Kubernetes Engine).
5+ years of experience in data engineering or backend/fullstack software development.
Strong SQL skills and Python scripting proficiency.
Experience with data transformation tools such as Databricks and Spark.
Familiarity with data manipulation libraries like Pandas, NumPy, and PySpark.
Ability to structure and model data in both relational and non-relational forms.
Experience with CI/CD tooling (GitHub, Azure DevOps, Harness).
Good verbal and written communication skills in English.

Nice to Have

Experience with Apache Hadoop and data modeling tools like DBT.
Familiarity with enterprise Data Warehouse solutions, preferably Snowflake.
Experience with ETL tools such as Informatica, Talend, Datastage, Stitch, Fivetran.
Experience in containerization and orchestration (Docker, Kubernetes).
Cloud certification (Azure, AWS, GCP).

Work Requirements

Must be able to work from the European Union region and have a valid work permit.

Recruitment Process

CV Review
HR Call
Interview
Optional Client Interview
Decision

Join us at Xebia, a place where experts grow, and be part of a team that is passionate about innovation and technological excellence.

Similar jobs

Last update: 23 minutes ago

Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

3 days ago

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

3 days ago

Senior DevOps Engineer with Linux, Kubernetes, and GCP

Join Redcare Pharmacy as a Senior DevOps Engineer to enhance infrastructure efficiency using Linux, Kubernetes, and GCP.

3 days ago

Data Engineer with Azure and PySpark

Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.

13 days ago

Senior Backend Engineer (Go)

Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.

7 days ago

Software Engineer - Cloud Applications and Python

Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.

2 days ago

Senior Python Developer with AWS Experience

Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.

3 days ago

Staff Software Engineer, Data Platform

Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.

3 days ago

Senior Backend Engineer (JavaScript & Node.js)

Join Devire as a Senior Backend Engineer specializing in JavaScript & Node.js, working on innovative fintech solutions in a hybrid role in Warsaw.

2 days ago

Senior Software Engineer - Python, Apache Kafka

Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.

3 days ago

AI Engineer

Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.

3 days ago

Full-Stack Engineer with Angular and React.js

Join Labelbox as a Full-Stack Engineer to develop scalable systems using Angular, React.js, and GraphQL. Work remotely in a dynamic AI-driven environment.

6 days ago

Senior Software Engineer - Python, Django, Angular

Join Ilkari as a Senior Software Engineer to lead development in Python, Django, and Angular, creating scalable solutions in a hybrid work environment.

3 days ago

Senior Software Engineer - Backend Development

Join Sysdig as a Senior Software Engineer to develop scalable backend services using Go, RESTful APIs, and microservices in a hybrid work environment.

7 days ago