Senior Data Engineer (Contract)
LHHJob Overview
LHH Recruitment Solutions is seeking a skilled Senior Data Engineer for a contract position. This role is fully remote and involves building a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be instrumental in driving new data projects, building reliable data pipelines, setting up strong monitoring and alerting systems, and building data solutions to support a diverse set of use cases.
Responsibilities
- Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.
- Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
- Utilize DBT to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
- Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
- Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
- Monitor and optimize data pipelines for performance and scalability.
- Develop and implement automated testing procedures to validate data quality and integrity after migration.
- Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.
Requirements
- Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
- Deep understanding of leveraging Snowflake to build highly performant and resilient data warehouse.
- Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
- Strong programming knowledge in python.
- Experience with Apache Spark for large-scale data processing (a plus).
- Proficiency in dbt for data modeling and transformation in Snowflake preferred.
- Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
- Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
- Strong problem-solving skills and a passion for building efficient and scalable data solutions.
- Snowflake certification preferred.
Preferred Qualifications
- Strong understanding of data architectures and patterns.
- Experience in DataOps implementation and support
- Experience in MLOps implementation and support.
- Experience in building and supporting AI/ML platform.
Benefits Extracted with AI
- 401(k)
- Commuter benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Short-term disability
- EAP program
Similar jobs
Last update: 23 minutes ago
Senior Data Engineer
Join us as a Senior Data Engineer in Lisbon to design and maintain data infrastructure. Hybrid role with flexible benefits.
Senior Data Scientist (Contractor)
Join Thoughtworks as a Senior Data Scientist (Contractor) to solve complex business problems using data science and machine learning.
Data Engineer with Blockchain and Cloud Experience
Join Messari as a Data Engineer to design blockchain data models, build dashboards, and derive insights. Remote role with competitive benefits.
Senior Cloud Engineer
Join as a Senior Cloud Engineer to architect and deploy cloud solutions using Azure, AWS, and GCP. Lead innovation in cloud technology.
Senior Machine Learning Engineer
Join as a Senior Machine Learning Engineer to design and deploy advanced ML solutions using Python, Spark, and cloud platforms. Remote work opportunity.
Remote Data Engineer - Research
Join Stability AI as a Remote Data Engineer to build scalable data infrastructure for AI models.
Senior Software Engineer, Machine Learning
Join as a Senior Software Engineer in Machine Learning, working remotely to build ML-driven products for user engagement.
Senior Data Engineer - Fintech Team
Join Agoda's fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology in a diverse and inclusive environment.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with Scala, Spark, Java, and more. Relocation provided.
Senior Data Engineer (Fintech)
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology and innovative projects. Relocation provided.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with Scala, Spark, Java, and more. Relocation provided.
Senior Data Engineer (Fintech)
Join Agoda's fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology to drive efficiencies and market opportunities.
Senior Data Engineer (Fintech)
Join Agoda's fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technologies in a dynamic environment.
Senior Data Engineer with Azure Expertise
Join Eliq as a Senior Data Engineer to enhance our Azure-based data platform and drive the energy transition.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Lead data systems, enhance scalability, and drive fintech innovation.
Senior Data Scientist, Analytics - Performance & Quality
Join as a Senior Data Scientist focusing on analytics, performance, and quality in a remote role with competitive salary and benefits.
Senior Data Engineer - Fintech
Join Agoda's Fintech team as a Senior Data Engineer in Berlin. Work with Java, Scala, and Big Data technologies to enhance data systems.
Senior Data Engineer - Fintech Team
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with Java, Scala, and Big Data technologies. Relocation provided.
Cloud Data Engineer
Join NPO as a Cloud Data Engineer to enhance data platforms using GCP, Python, and more. Flexible hours and growth opportunities.
Senior Data Engineer - Fintech Team
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Lead data system improvements using Java, Scala, and Spark.
Senior Data Engineer (Fintech)
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology and innovative projects. Relocation provided.
Senior Data Engineer (Fintech Team)
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Work with cutting-edge technology and innovative projects. Relocation provided.
Senior Data Engineer - Fintech Team
Join Agoda's Fintech team as a Senior Data Engineer in Bangkok. Enhance data systems with Java, Scala, and Spark. Relocation provided.
Remote Software Engineer
Join our team as a Remote Software Engineer, developing high-quality code in an agile environment. Skills in microservices, API development, and cloud computing required.