Senior Data Engineer with Scala and Spark

Job Description

Position Summary

We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, and Google Cloud Platform (GCP). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensuring data quality and integrity.

About the Team

Everyone has data, but the sheer volume of data at Walmart can be limitless. In the Data Engineering team, we help Walmart manage this data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We also use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster.

What You'll Do

• Collaborate with cross-functional teams to understand data requirements and design data solutions that meet business needs.
• Develop and maintain data pipelines and ETL processes using Spark and Scala.
• Design, build, and optimize data models and data architecture for efficient data processing and storage.
• Implement data integration and data transformation workflows to ensure data quality and consistency.
• Monitor and troubleshoot data pipelines to ensure data availability and reliability.
• Conduct performance tuning and optimization of data processing systems for improved efficiency and scalability.
• Work closely with data scientists and analysts to provide them with the necessary data sets and tools for analysis and reporting.
• Stay up-to-date with the latest industry trends and technologies in data engineering and apply them to enhance the data infrastructure.

What You'll Bring

• Proven working experience as a Data Engineer with a minimum of 3 years in the field.
• Strong programming skills in Scala and experience with Spark for data processing and analytics.
• Familiarity with Google Cloud Platform (GCP) services such as BigQuery, GCS, Dataproc, Pub/Sub, etc.
• Experience with data modeling, data integration, and ETL processes.
• Strong knowledge of SQL and database systems.
• Understanding of data warehousing concepts and best practices.
• Proficiency in working with large-scale data sets and distributed computing frameworks.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.

About Walmart Global Tech

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity experts, and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions, and reimagine the future of retail.

Flexible, Hybrid Work

We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose, and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team, and be more flexible in our personal lives.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.

Equal Opportunity Employer

Walmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity- unique styles, experiences, identities, ideas, and opinions - while being inclusive of all people.

The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.

At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision, and dental coverage. Financial benefits include 401(k), stock purchase, and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.