Mapiq logo

Data Engineer with Apache Spark Experience

Mapiq

Join Mapiq as a Data Engineer

Are you passionate about data engineering and eager to work with cutting-edge technology? Mapiq is looking for a Data Engineer to join our dynamic Data Team. In this role, you will have the opportunity to make a significant impact on our product by building and maintaining scalable data pipelines that leverage large datasets from sensors and business applications.

Key Responsibilities

  • Design and Develop Data Pipelines: Create and maintain scalable data pipelines and systems to process large datasets efficiently.
  • Optimize ETL Processes: Work with large datasets to optimize data extraction, transformation, and loading (ETL) processes.
  • Implement Spark Solutions: Develop and optimize Spark-based solutions for data processing and analysis.
  • Collaborate Across Teams: Work with cross-functional teams to define, implement, and monitor data quality metrics.
  • Ensure Data Security: Maintain data security, compliance, and governance across all pipelines.
  • Troubleshoot Issues: Resolve issues related to data systems, processes, and infrastructure.

Who We Are Looking For

We are seeking a candidate with at least 2 years of experience in a similar role. The ideal candidate will have:

  • A Bachelor's degree in Computer Science or a related field.
  • Proficiency in Python for data processing and automation.
  • Proficiency in SQL for database management and query optimization.
  • A solid understanding of Spark concepts, including Spark DataFrame, Spark SQL, and Spark Streaming.

Nice-to-Have Qualifications

  • Experience with Databricks and Databricks certifications.
  • Knowledge of DBT (Data Build Tool) for data transformation.
  • Experience with Infrastructure as Code (IaC) tools like Terraform or Bicep.
  • Familiarity with Azure DevOps Pipeline for CI/CD processes.
  • Experience with the Azure Ecosystem, including Azure SQL Server, Azure CosmosDB, Azure EventHub, Azure ServiceBus, and Azure FunctionApp.

What We Offer

  • Hybrid Working Environment: Enjoy the flexibility of working both on-site and off-site.
  • Global Workstation: Work from anywhere in the world for one month each year.
  • Professional Development: Access to Databricks Academy for continuous learning and certification opportunities.
  • Competitive Compensation: We offer a fair salary based on your experience and skills.
  • Comprehensive Benefits: Pension plan, 25 vacation days, travel reimbursement, and more.
  • Supportive Community: Join a team of board game enthusiasts, sports fanatics, coffee lovers, and more.

At Mapiq, we value diversity and strive to create an inclusive environment where everyone can bring their unique ideas and backgrounds to the table. If you are ready to take on this exciting challenge, we would love to hear from you!

Benefits
Extracted with AI

  • Pension plan
  • Hybrid working environment
  • One month workstation from anywhere
  • Free mental health support
  • Competitive pay
  • €300 home office reimbursement
  • Databricks Academy access
  • 25 vacation days
  • Travel reimbursement

Similar jobs

Last update: 23 minutes ago

BeFrank logo
BeFrank

Data Engineer with Azure and PySpark

Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.

Holland Casino logo
Holland Casino

Data Engineer with ETL and SQL Expertise

Join Holland Casino as a Data Engineer to build and maintain data infrastructure for the Online Casino, focusing on ETL, SQL, and cloud solutions.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

i4talent detachering logo
i4talent detachering

Senior Data Engineer

Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.

Topicus logo
Topicus

Software Engineer - Cloud Applications and Python

Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.

Skytree logo
Skytree

Senior IoT Engineer

Join Skytree as a Senior IoT Engineer to lead IoT projects, focusing on Azure IoT solutions, edge computing, and data pipelines.

Catalyze Group logo
Catalyze Group

Full Stack Developer with AI and API Expertise

Join Catalyze Group as a Full Stack Developer to build AI-powered grant-writing tools. Work with React, Django, and more in Amsterdam.

Albert Heijn logo
Albert Heijn

Oracle Cloud Engineer

Join Albert Heijn as an Oracle Cloud Engineer to drive automation and manage cloud infrastructure in Zaandam, Netherlands.

Reaktor logo
Reaktor

Lead Developer with DevOps and Functional Programming

Join Reaktor as a Lead Developer in Amsterdam, focusing on DevOps, Functional Programming, and JavaScript in a hybrid work environment.

Tibo Energy Management Software logo
Tibo Energy Management Software

Cloud Engineer

Join Tibo Energy as a Cloud Engineer to drive energy transition with cloud architecture skills in a dynamic team.

Zalando logo
Zalando

Senior Backend/Data Engineer

Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.

Kennisnet logo
Kennisnet

Software Developer for Educational Platforms

Join Kennisnet as a Software Developer to create innovative educational platforms using Angular, PHP, and more. Hybrid work in Zoetermeer.

Stichting RINIS logo
Stichting RINIS

Senior Developer with C#, Java, and Python

Join RINIS as a Senior Developer to build secure data exchange solutions using C#, Java, Python, and more in a hybrid work environment.

Kadaster logo
Kadaster

Java Engineer with Angular and Spring Framework

Join Kadaster as a Java Engineer, working with Java, Spring, and Angular in a hybrid environment. Contribute to property information software.

Basetime BV logo
Basetime BV

Senior Python Developer with AWS Experience

Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

Personio logo
Personio

Staff Software Engineer, Data Platform

Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.

Darktrace logo
Darktrace

Solutions Engineer

Join Darktrace as a Solutions Engineer in Amsterdam, providing technical pre-sales and post-sales support in a hybrid work environment.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

Mediahuis Nederland logo
Mediahuis Nederland

Full-stack TypeScript/JavaScript Developer

Join Mediahuis as a Full-stack TypeScript/JavaScript Developer in Amsterdam. Work on our Customer Journey Builder platform in a hybrid environment.

ING logo
ING

Senior Elastic Stack as a Service (ELKaaS) DevOps Engineer

Join ING as a Senior DevOps Engineer to enhance our ELKaaS platform, leveraging Docker, Kubernetes, and Azure in a hybrid work environment.

Zivver logo
Zivver

Front-end Angular Engineer

Join Zivver as a Front-end Angular Engineer to shape the future of secure web applications. Work with Angular, TypeScript, and more in Amsterdam.

Instapro Group logo
Instapro Group

Senior Backend Engineer - PHP, Symfony, Laravel

Join Instapro Group as a Senior Backend Engineer, working with PHP, Symfony, and Laravel in a hybrid environment.

Elastic logo
Elastic

Software Engineer II - Developer Experience

Join Elastic as a Software Engineer II in Developer Experience, focusing on test frameworks for Kibana. Remote work, competitive benefits.