About the Role
We are seeking a Senior GCP Data Engineer (Databricks) to join our team at Xebia Poland. This role is perfect for someone who is passionate about cloud-based solutions and has a strong background in data engineering and backend development. You will be responsible for designing, building, and deploying scalable infrastructure with a focus on distributed systems. Your work will involve creating architecture patterns for data processing, workflow definitions, and system integrations using Big Data and Cloud technologies.
Key Responsibilities
- Design, build, and deploy at-scale infrastructure with a focus on distributed systems.
- Develop and maintain architecture patterns for data processing and system integrations.
- Evaluate and translate technical designs into workable solutions and technical specifications.
- Drive the creation of reusable artifacts and establish automated processes for data analysis and model development.
- Collaborate with analysts and data scientists to understand the impact on downstream data models.
- Write efficient and well-organized software to ship products in an iterative release environment.
- Promote good software engineering practices across the team.
- Communicate effectively with both technical and non-technical audiences.
- Define data retention policies and monitor performance to advise on necessary infrastructure changes.
Your Profile
- 3+ years of experience with GCP (BigQuery, Dataflow, Pub/Sub, Bigtable, Dataproc, Storage, Kubernetes Engine).
- 5+ years of experience in data engineering or backend/fullstack software development.
- Strong SQL skills and Python scripting proficiency.
- Experience with data transformation tools such as Databricks and Spark.
- Familiarity with data manipulation libraries like Pandas, NumPy, and PySpark.
- Ability to structure and model data in both relational and non-relational forms.
- Experience with CI/CD tooling (GitHub, Azure DevOps, Harness).
- Good verbal and written communication skills in English.
Nice to Have
- Experience with Apache Hadoop and data modeling tools like DBT.
- Familiarity with enterprise Data Warehouse solutions, preferably Snowflake.
- Experience with ETL tools such as Informatica, Talend, Datastage, Stitch, Fivetran.
- Experience in containerization and orchestration (Docker, Kubernetes).
- Cloud certification (Azure, AWS, GCP).
Work Requirements
- Must be able to work from the European Union region and have a valid work permit.
Recruitment Process
- CV Review
- HR Call
- Interview
- Optional Client Interview
- Decision
Join us at Xebia, a place where experts grow, and be part of a team that is passionate about innovation and technological excellence.
Similar jobs
Last update: 23 minutes ago
Lead Data Engineer with GCP Expertise
Lead Data Engineer role in Berlin, focusing on GCP, BigQuery, and data pipelines.
Machine Learning Engineer
Join MoonPay as a Machine Learning Engineer to build and maintain ML infrastructure, collaborating with data scientists and cross-functional teams.
ML Platform Engineer
Join Pipedrive as an ML Platform Engineer in Tallinn. Build and maintain ML platform components for Data Scientists and ML Engineers.
Solutions Engineer with Data Analytics and GCP Experience
Join Databricks as a Solutions Engineer in Amsterdam, leveraging data analytics and GCP expertise to solve complex data challenges.
Backend Engineer (TypeScript/NodeJS)
Join GlobalLogic as a Backend Engineer to work on innovative projects using TypeScript, NodeJS, and more. Hybrid work in Szczecin, Poland.
Senior Cloud Platform Engineer
Join Strava as a Senior Cloud Platform Engineer in Berlin, working on cloud infrastructure, containerization, and observability tools.
Data Engineer - Experimentation Platform
Join Zalando as a Data Engineer to enhance our Experimentation Platform with Python, SQL, and AWS skills.
SRE Engineering Manager
Join Mindbox SA as an SRE Engineering Manager in Warsaw. Lead teams, manage software development, and ensure reliability in a hybrid work environment.
Data Engineer
Join our team as a Data Engineer in Amsterdam, focusing on data pipelines, quality, and scaling using PySpark, Snowflake, Airflow, and AWS.
Software Engineer - Python, AWS, SQL
Join a healthtech startup as a Software Engineer in NYC, focusing on Python, AWS, and SQL. On-site role with competitive salary and benefits.
Senior Full Stack Engineer with Python and GraphQL
Join Kpler as a Senior Full Stack Engineer to design APIs and data pipelines using Python and GraphQL.
Senior Back End Developer (Node.js)
Join Ciklum as a Senior Back End Developer (Node.js) in Romania. Work remotely on innovative projects with a global impact.
Senior Fullstack Developer (Python, React)
Join Semrush as a Senior Fullstack Developer to lead our experimentation platform using Python and React. Remote work available.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Analytics Engineer (Data Product & Research Team)
Join Semrush as an Analytics Engineer to develop data pipelines and enhance analytics tools. Work remotely with flexible hours.
Remote Software Engineer with Python Expertise
Join Bloomreach as a Remote Software Engineer, focusing on Python, AI, and data-driven insights.
Software Engineer - Data Platform
Join Bot Auto as a Software Engineer to design and evolve our hybrid-Cloud data platform. Work remotely with cutting-edge technology in autonomous trucking.
Lead Back End Developer (Node.js)
Join Ciklum as a Lead Back End Developer (Node.js) in Poland. Lead core services design, mentor team, and work with cutting-edge technologies.
Senior Fullstack Developer with Python, C#, and JavaScript
Join Seargin as a Senior Fullstack Developer. Work with Python, C#, JavaScript in a hybrid role in Gdańsk. Enhance your skills in a dynamic environment.
Senior React Developer
Join Cloudflight as a Senior React Developer to build high-performance web applications using React, TypeScript, and Tailwind CSS.
Python AI Developer Advocate
Join Stream as a Python AI Developer Advocate to build community and enhance AI integrations. Engage with developers and influence product roadmaps.
Senior Frontend Engineer
Join bp as a Senior Frontend Engineer in Budapest, focusing on ReactJS, Angular, and NodeJS development in a hybrid work environment.
Senior Back End Developer (Golang)
Join Norma as a Senior Back End Developer in Athens, Greece. Work with Golang, APIs, and cloud technologies in a hybrid environment.
Python Backend Developer / MLOps Engineer
Join Prompt Therapy Solutions as a Python Backend Developer / MLOps Engineer to enhance AI infrastructure and backend systems remotely.