Job Overview
LHH Recruitment Solutions is seeking a skilled Senior Data Engineer for a contract position. This role is fully remote and involves building a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be instrumental in driving new data projects, building reliable data pipelines, setting up strong monitoring and alerting systems, and building data solutions to support a diverse set of use cases.
Responsibilities
- Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.
- Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
- Utilize DBT to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
- Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
- Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
- Monitor and optimize data pipelines for performance and scalability.
- Develop and implement automated testing procedures to validate data quality and integrity after migration.
- Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.
Requirements
- Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
- Deep understanding of leveraging Snowflake to build highly performant and resilient data warehouse.
- Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
- Strong programming knowledge in python.
- Experience with Apache Spark for large-scale data processing (a plus).
- Proficiency in dbt for data modeling and transformation in Snowflake preferred.
- Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
- Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
- Strong problem-solving skills and a passion for building efficient and scalable data solutions.
- Snowflake certification preferred.
Preferred Qualifications
- Strong understanding of data architectures and patterns.
- Experience in DataOps implementation and support
- Experience in MLOps implementation and support.
- Experience in building and supporting AI/ML platform.
Benefits Extracted with AI
- 401(k)
- Commuter benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Short-term disability
- EAP program
Similar jobs
Last update: 23 minutes ago
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Data Engineer with Azure and PySpark
Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Senior Full Stack Engineer (PHP, Angular, React)
Seeking a Senior Full Stack Engineer with PHP, Angular, React expertise for remote work in the EU. 6+ years experience required.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior GCP Data Engineer (Databricks)
Join Xebia Poland as a Senior GCP Data Engineer, focusing on Databricks, Python, and SQL for cloud-based solutions.
Senior Product Engineer [Rust & Typescript]
Join Attio as a Senior Product Engineer working with Rust & TypeScript to build innovative CRM features. Remote work available.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Senior Software Engineer (Node.js & TypeScript)
Join n8n as a Senior Software Engineer to build AI applications using Node.js and TypeScript. Remote role within Europe.
Freelance Fullstack Java Developer for Insurance Projects
Seeking freelance Fullstack Java Developers for remote insurance projects. Must be based in Germany, fluent in German, and experienced in Java, Spring Boot.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Mid-Level Full Stack Software Engineer - Cloud & Web
Join as a Full Stack Software Engineer focusing on C#, Azure, and Microservices in a dynamic team with flexible work options.
Full-Stack Engineer with Angular and React.js
Join Labelbox as a Full-Stack Engineer to develop scalable systems using Angular, React.js, and GraphQL. Work remotely in a dynamic AI-driven environment.
Senior Full Stack Engineer - Climate Tech - Rust & TypeScript
Join Climatiq as a Senior Full Stack Engineer to develop climate tech solutions using Rust and TypeScript. Remote work available.
Senior Full-stack Engineer (Angular, Node.js, TypeScript)
Join NN Group as a Senior Full-stack Engineer, leading software architecture and development with Angular, Node.js, and TypeScript.
Senior Full Stack Engineer
Join PiNCAMP as a Senior Full Stack Engineer to build innovative camping solutions using Python, JavaScript, and cloud technologies.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Software Engineer II - Developer Experience
Join Elastic as a Software Engineer II in Developer Experience, focusing on test frameworks for Kibana. Remote work, competitive benefits.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.