About the Role
We are seeking a Senior GCP Data Engineer (Databricks) to join our team at Xebia Poland. This role is perfect for someone who is passionate about cloud-based solutions and has a strong background in data engineering and backend development. You will be responsible for designing, building, and deploying scalable infrastructure with a focus on distributed systems. Your work will involve creating architecture patterns for data processing, workflow definitions, and system integrations using Big Data and Cloud technologies.
Key Responsibilities
- Design, build, and deploy at-scale infrastructure with a focus on distributed systems.
- Develop and maintain architecture patterns for data processing and system integrations.
- Evaluate and translate technical designs into workable solutions and technical specifications.
- Drive the creation of reusable artifacts and establish automated processes for data analysis and model development.
- Collaborate with analysts and data scientists to understand the impact on downstream data models.
- Write efficient and well-organized software to ship products in an iterative release environment.
- Promote good software engineering practices across the team.
- Communicate effectively with both technical and non-technical audiences.
- Define data retention policies and monitor performance to advise on necessary infrastructure changes.
Your Profile
- 3+ years of experience with GCP (BigQuery, Dataflow, Pub/Sub, Bigtable, Dataproc, Storage, Kubernetes Engine).
- 5+ years of experience in data engineering or backend/fullstack software development.
- Strong SQL skills and Python scripting proficiency.
- Experience with data transformation tools such as Databricks and Spark.
- Familiarity with data manipulation libraries like Pandas, NumPy, and PySpark.
- Ability to structure and model data in both relational and non-relational forms.
- Experience with CI/CD tooling (GitHub, Azure DevOps, Harness).
- Good verbal and written communication skills in English.
Nice to Have
- Experience with Apache Hadoop and data modeling tools like DBT.
- Familiarity with enterprise Data Warehouse solutions, preferably Snowflake.
- Experience with ETL tools such as Informatica, Talend, Datastage, Stitch, Fivetran.
- Experience in containerization and orchestration (Docker, Kubernetes).
- Cloud certification (Azure, AWS, GCP).
Work Requirements
- Must be able to work from the European Union region and have a valid work permit.
Recruitment Process
- CV Review
- HR Call
- Interview
- Optional Client Interview
- Decision
Join us at Xebia, a place where experts grow, and be part of a team that is passionate about innovation and technological excellence.
Similar jobs
Last update: 23 minutes ago
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Cloud Engineer
Join Tibo Energy as a Cloud Engineer to drive energy transition with cloud architecture skills in a dynamic team.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Senior Data Engineer
Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.
Senior Full-Stack Engineer ReactJS/NodeJS
Join Gorgias as a Senior Full-Stack Engineer specializing in ReactJS and NodeJS, enhancing AI-powered ecommerce solutions.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior DevOps Engineer with Linux, Kubernetes, and GCP
Join Redcare Pharmacy as a Senior DevOps Engineer to enhance infrastructure efficiency using Linux, Kubernetes, and GCP.
Software Engineer - Cloud Applications and Python
Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Backend Engineer (JavaScript & Node.js)
Join Devire as a Senior Backend Engineer specializing in JavaScript & Node.js, working on innovative fintech solutions in a hybrid role in Warsaw.
Data Engineer with ETL and SQL Expertise
Join Holland Casino as a Data Engineer to build and maintain data infrastructure for the Online Casino, focusing on ETL, SQL, and cloud solutions.
Backend Software Engineer - Privacy Technology
Join Zalando as a Backend Software Engineer in Privacy Technology, focusing on data protection and privacy automation services.
Mid/Senior Backend Developer (Python, Golang)
Join Mobik as a Mid/Senior Backend Developer to develop solutions for global telco players using Python and Golang.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
AI Engineer
Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.
Senior Software Engineer - Python, Django, Angular
Join Ilkari as a Senior Software Engineer to lead development in Python, Django, and Angular, creating scalable solutions in a hybrid work environment.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Senior Backend Developer (Node.js) / SRE
Join Binance as a Senior Backend Developer (Node.js) / SRE to develop monitoring systems for high-load production environments.
Senior API Platform Engineer
Join Brenntag as a Senior API Platform Engineer in Amsterdam to drive API platform development using Kubernetes, Istio, and AWS EKS.
Senior Cloud DevOps Engineer
Join netgo as a Senior Cloud DevOps Engineer in Berlin. Work with Kubernetes, GitOps, and more in a dynamic team environment.
Intermediate Backend Engineer - Ruby on Rails, PostgreSQL
Join GitLab as an Intermediate Backend Engineer to enhance CI platform performance using Ruby on Rails and PostgreSQL in a remote role.