Mapiq logo

Data Engineer with Apache Spark Experience

Mapiq

Join Mapiq as a Data Engineer

Are you passionate about data engineering and eager to work with cutting-edge technology? Mapiq is looking for a Data Engineer to join our dynamic Data Team. In this role, you will have the opportunity to make a significant impact on our product by building and maintaining scalable data pipelines that leverage large datasets from sensors and business applications.

Key Responsibilities

  • Design and Develop Data Pipelines: Create and maintain scalable data pipelines and systems to process large datasets efficiently.
  • Optimize ETL Processes: Work with large datasets to optimize data extraction, transformation, and loading (ETL) processes.
  • Implement Spark Solutions: Develop and optimize Spark-based solutions for data processing and analysis.
  • Collaborate Across Teams: Work with cross-functional teams to define, implement, and monitor data quality metrics.
  • Ensure Data Security: Maintain data security, compliance, and governance across all pipelines.
  • Troubleshoot Issues: Resolve issues related to data systems, processes, and infrastructure.

Who We Are Looking For

We are seeking a candidate with at least 2 years of experience in a similar role. The ideal candidate will have:

  • A Bachelor's degree in Computer Science or a related field.
  • Proficiency in Python for data processing and automation.
  • Proficiency in SQL for database management and query optimization.
  • A solid understanding of Spark concepts, including Spark DataFrame, Spark SQL, and Spark Streaming.

Nice-to-Have Qualifications

  • Experience with Databricks and Databricks certifications.
  • Knowledge of DBT (Data Build Tool) for data transformation.
  • Experience with Infrastructure as Code (IaC) tools like Terraform or Bicep.
  • Familiarity with Azure DevOps Pipeline for CI/CD processes.
  • Experience with the Azure Ecosystem, including Azure SQL Server, Azure CosmosDB, Azure EventHub, Azure ServiceBus, and Azure FunctionApp.

What We Offer

  • Hybrid Working Environment: Enjoy the flexibility of working both on-site and off-site.
  • Global Workstation: Work from anywhere in the world for one month each year.
  • Professional Development: Access to Databricks Academy for continuous learning and certification opportunities.
  • Competitive Compensation: We offer a fair salary based on your experience and skills.
  • Comprehensive Benefits: Pension plan, 25 vacation days, travel reimbursement, and more.
  • Supportive Community: Join a team of board game enthusiasts, sports fanatics, coffee lovers, and more.

At Mapiq, we value diversity and strive to create an inclusive environment where everyone can bring their unique ideas and backgrounds to the table. If you are ready to take on this exciting challenge, we would love to hear from you!

Benefits
Extracted with AI

  • Pension plan
  • Hybrid working environment
  • One month workstation from anywhere
  • Free mental health support
  • Competitive pay
  • €300 home office reimbursement
  • Databricks Academy access
  • 25 vacation days
  • Travel reimbursement

Similar jobs

Last update: 23 minutes ago

BeFrank logo
BeFrank

Data Engineer with Azure and PySpark

Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.

Sanoma Learning logo
Sanoma Learning

Data Engineer with ETL and PySpark Experience

Join Sanoma Learning as a Data Engineer, focusing on ETL, PySpark, and data warehousing in a dynamic educational environment.

Albert Heijn logo
Albert Heijn

Data Platform Engineer (Kafka, Databricks, Python, Azure)

Join Albert Heijn as a Data Platform Engineer to enhance our data platform using Kafka, Databricks, Python, and Azure.

Adyen logo
Adyen

Data Engineer II

Join Adyen as a Data Engineer II in Amsterdam. Engage in building high-quality data pipelines and optimizing big data systems.

DPG Media Nederland logo
DPG Media Nederland

Medior Data Engineer

Join DPG Media as a Medior Data Engineer to build and maintain cloud-based data pipelines in Amsterdam.

Computer Futures logo
Computer Futures

Data Engineer

Join our team as a Data Engineer in Amsterdam, focusing on data pipelines, quality, and scaling using PySpark, Snowflake, Airflow, and AWS.

Xylos logo
Xylos

Data Engineer with Microsoft Azure Expertise

Join Xylos as a Data Engineer to develop modern data platforms using Microsoft Azure, Python, and SQL in a hybrid work environment.

RevoData logo
RevoData

Principal Data Engineer

Lead the development of data and AI solutions in a hybrid setup at RevoData, Amsterdam. Skills required: SQL, Python, ETL.

Quatt logo
Quatt

Senior Data Engineer

Join Quatt as a Senior Data Engineer to build and optimize data infrastructure for sustainable energy solutions.

Tropos.io logo
Tropos.io

Experienced Data Engineer

Join Tropos.io as an Experienced Data Engineer in Antwerp, Belgium. Engage in building high-quality data solutions with a leading IT consulting firm.

Holland Casino logo
Holland Casino

Data Engineer with ETL and SQL Expertise

Join Holland Casino as a Data Engineer to build and maintain data infrastructure for the Online Casino, focusing on ETL, SQL, and cloud solutions.

Mapiq logo
Mapiq

Senior Back End Developer (C#, .NET, Azure)

Join Mapiq as a Senior Back End Developer. Work with C#, .NET, and Azure to enhance our workplace experience platform.

Ocean Finance logo
Ocean Finance

Senior Data Engineer - Apache Spark, PySpark, Azure Databricks

Senior Data Engineer specializing in Apache Spark, PySpark, and Azure Databricks for a leading UK fintech company.

Otrium logo
Otrium

Senior Data Engineer

Senior Data Engineer needed in Amsterdam. Hybrid role with competitive benefits, focusing on data-driven solutions in fashion tech.

Blip logo
Blip

Senior Data Platform Engineer

Senior Data Platform Engineer needed for Blip, focusing on Big Data management and cloud solutions. Expertise in SQL, Python, Spark, and cloud platforms required.

Bynder logo
Bynder

Data Engineer

Join Bynder as a Data Engineer in Amsterdam, working on asset migrations, custom reports, and enhancing customer metadata experience.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

SeQura logo
SeQura

Senior Data Engineer

Join SeQura as a Senior Data Engineer to develop and maintain data pipelines using AWS, Python, and SQL in a hybrid work environment.

RTL Nederland logo
RTL Nederland

Data Platform Engineer

Join RTL Nederland as a Data Platform Engineer to manage cloud platforms and develop data solutions.

Inclusively logo
Inclusively

Data Engineer with Microsoft Azure and Python

Join as a Data Engineer in New York, focusing on Azure, Python, and data solutions. Competitive salary and benefits offered.

Pipedrive logo
Pipedrive

Senior Data Engineer

Senior Data Engineer needed in Tallinn to design and maintain data pipelines using Apache Spark, Kafka, and AWS.

DPG Media Nederland logo
DPG Media Nederland

Senior Machine Learning Engineer

Senior ML Engineer in Amsterdam, focusing on AI, data pipelines, and digital advertising solutions.

MoonPay logo
MoonPay

Senior Data Engineer

Senior Data Engineer needed in Madrid for MoonPay, focusing on real-time analytics, cloud computing, and data-driven initiatives.

Skyscanner logo
Skyscanner

Senior Data Engineer

Senior Data Engineer role in Barcelona, skilled in Python, Spark, AWS, SQL, and big data processing.