Job Overview
LHH Recruitment Solutions is seeking a skilled Senior Data Engineer for a contract position. This role is fully remote and involves building a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be instrumental in driving new data projects, building reliable data pipelines, setting up strong monitoring and alerting systems, and building data solutions to support a diverse set of use cases.
Responsibilities
- Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.
- Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
- Utilize DBT to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
- Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
- Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
- Monitor and optimize data pipelines for performance and scalability.
- Develop and implement automated testing procedures to validate data quality and integrity after migration.
- Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.
Requirements
- Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
- Deep understanding of leveraging Snowflake to build highly performant and resilient data warehouse.
- Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
- Strong programming knowledge in python.
- Experience with Apache Spark for large-scale data processing (a plus).
- Proficiency in dbt for data modeling and transformation in Snowflake preferred.
- Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
- Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
- Strong problem-solving skills and a passion for building efficient and scalable data solutions.
- Snowflake certification preferred.
Preferred Qualifications
- Strong understanding of data architectures and patterns.
- Experience in DataOps implementation and support
- Experience in MLOps implementation and support.
- Experience in building and supporting AI/ML platform.
Benefits Extracted with AI
- 401(k)
- Commuter benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Short-term disability
- EAP program
Similar jobs
Last update: 23 minutes ago
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Senior Data Engineer
Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Data Engineer with ETL and SQL Expertise
Join Holland Casino as a Data Engineer to build and maintain data infrastructure for the Online Casino, focusing on ETL, SQL, and cloud solutions.
Senior Data Engineer - Snowflake, AWS, SQL, Python (Freelance/Short-term Contract)
Senior Data Engineer specializing in Snowflake, AWS, SQL, and Python for a freelance/short-term contract in Lisbon.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Software Engineer - Polaris & Data Lake Catalog
Join Snowflake as a Senior Software Engineer to build and evolve our open data lake ecosystem with Java, Scala, and C++.
Senior Cloud Data Engineer
Senior Cloud Data Engineer role focusing on data architecture, pipeline design, and cloud platforms like AWS and Snowflake.
Senior GCP Data Engineer (Databricks)
Join Xebia Poland as a Senior GCP Data Engineer, focusing on Databricks, Python, and SQL for cloud-based solutions.
Senior Data Platform Engineer
Senior Data Platform Engineer needed for Blip, focusing on Big Data management and cloud solutions. Expertise in SQL, Python, Spark, and cloud platforms required.
Senior Data Engineer
Senior Data Engineer role focusing on ETL, Python, and Big Data in a remote setting with comprehensive benefits.
LLM Backend Developer
Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Full Stack Engineer (PHP, Angular, React)
Seeking a Senior Full Stack Engineer with PHP, Angular, React expertise for remote work in the EU. 6+ years experience required.
Senior Analytics Engineer
Join Remote as a Senior Analytics Engineer to drive impactful decision-making with data analytics and engineering.
Senior Data Engineer
Senior Data Engineer needed in Denver, CO. Hybrid role with a salary range of $155K-$175K plus benefits.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Data Engineer
Join our team as a Data Engineer in Amsterdam, focusing on data pipelines, quality, and scaling using PySpark, Snowflake, Airflow, and AWS.
Data Engineer with Azure and PySpark
Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.
Senior Data Engineer
Join us as a Senior Data Engineer in Lisbon to design and maintain data infrastructure. Hybrid role with flexible benefits.
Lead Data Engineer with GCP Expertise
Lead Data Engineer role in Berlin, focusing on GCP, BigQuery, and data pipelines.
Senior Data Engineer
Senior Data Engineer needed to develop high-scale data systems using Python, PostgreSQL, and cloud services. Remote work flexibility.