Senior Data Engineer - Identity Data

Job Overview

Join The Walt Disney Company as a Senior Data Engineer within the Identity Data Engineering team. You will play a crucial role in designing and building data pipelines for foundational data sets related to Identity, Account, Profile, and Device data. This position involves collaborating with various teams to provide data and data-related services across all Disney companies.

Key Responsibilities

• Design and Implement ETL Pipelines: Develop performant data solutions that are reliable and scalable in a fast-growing data ecosystem. This includes defining data quality checks and validations and orchestrating pipelines using Airflow.
• Code and Application Improvement: Write code, research, solve issues, and improve applications. Support several legacy applications as we migrate functionality to new applications.
• Collaboration: Work with upstream/downstream data providers, internal teams, and external vendors. Collaborate with tech teams in architecture, infrastructure/platform, DevOps, SecOps, QA, data analysts, and data science.
• Technical Project Management: Partner with Technical Project Managers and Product Owners on task definition, estimation, and refinement.

Required Qualifications

• Experience: 5+ years of relevant experience, including 4+ years of professional programming experience with Java, Python, and/or Scala.
• Data Engineering: 3+ years of experience developing large data pipelines with MapReduce/Spark/PySpark and hands-on experience with AWS.
• Communication Skills: Strong written and verbal communication skills, able to communicate effectively at all levels.

Preferred Qualifications

• Technical Communication: Ability to describe highly technical details in terms the audience will understand.
• Agile Experience: Familiarity with Agile Scrum principles and ceremonies.
• SQL and Databases: 4+ years of experience using analytic SQL with traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Snowflake/Redshift.
• ETL Tools: 2+ years of experience with data orchestration/ETL tools such as Airflow, Nifi.
• Data Exploration: Familiarity with data exploration/data visualization.
• Graph Databases: Exposure to Graph Databases and query languages (Neptune, Janus, Neo4j, Gremlin/Cypher).
• Streaming Systems: Experience with messaging and/or streaming systems (Kafka, Kinesis, Spark Streaming).

Education

• Bachelor’s Degree in Computer Science, Information Systems, or related field, or equivalent work experience. A Master’s Degree is a plus.

Why Join Us?

At Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while transforming Disney’s media business for the future. Our team builds on cloud-based technology, often pushing the edge of what is available and solving for scalability, reliability, resilience, and performance. Our engineers work on challenges and problems not found in most companies due to volume, scale, near-real-time, and latency requirements.

Location

This position is based in Seattle, Washington, and requires on-site work.

Compensation

The salary range for this position in Seattle, Washington, is €142,516 to €191,180 per year. The base pay offered will take into account internal equity and may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.