1+ months

Sr Director, Data Engineering

Walmart
Sunnyvale, CA 94086
Apply Now
Apply on the Company Site
1405863BRReq ID:1405863BRCompany Summary:At Walmart, we work every day to create solutions and products that save our customers time and money. Our Global Data organization is transforming Walmart into a data-driven company by creating a high-quality data asset, managing that asset, and making data and insights readily available to help business users to drive results. Our data platforms are highly performant, deployed at scale, and being leveraged across our business units today; however significant work is needed to migrate the current Walmart data asset into the central platform where it can be managed and distributed in a well-governed way. We are seeking a leader who will direct critical efforts in building our next generation of data engineering including data management, data governance, data pipelines and the data consumption layer. Responsibilities include managing a large team that interacts with various business units and functions, translates business requirements into solutions and then builds mission-critical pipelines to capture data and make it accessible. You will partner with other technology and business leaders to drive significant change at Walmart in moving the company towards a data-driven culture. You will lead a team of world-class data engineers hungry to apply leading-edge technologies to deliver great customer experiences. You and your team will play essential roles in building data products that deliver on Walmarts commitments to our customers. You will collaborate closely with business leaders to deliver relevant data and insight to inform our strategy and decisions.Job Title:Sr Director, Data EngineeringPosition Summary:We are looking for a leader to build and lead a world-class data engineering team that delivers high-quality data assets to our internal customers, and provides the foundation of high-quality data to power our data science and machine learning applications. In addition, this leader will redefine our data engineering processes and implement new best practices to increase capacity and efficiency in the organization. This leader will leverage our Enterprise Data Platform and collaborate with engineering teams to guide the evolution of our data systems to meet the challenges of increasing scale and complexity required in todays world. This entails recommending choices in our architectures for data storage, distribution, management, processing, serving, and consumption. This is a critical role in our journey towards becoming a data-driven company. Key Responsibilities Create a great engineering team culture with high levels of team engagement and satisfaction, successfully mentoring team members, and growing leaders in high-performing organizations Partner with business and product leaders to define data engineering roadmaps to scope and solve business problems Create designs/plans to scale, harden and extend data architectures and pipelines in environments that match Walmarts scale Run large-scale migration and evolution of data-centric systems Run operations while also redesigning / modernizing data engineering processes and technologyCity:SUNNYVALEState:CAPosition Description:We are looking for a leader to build and lead a world-class data engineering team that delivers high-quality data assets to our internal customers, and provides the foundation of high-quality data to power our data science and machine learning applications. In addition, this leader will redefine our data engineering processes and implement new best practices to increase capacity and efficiency in the organization. This leader will leverage our Enterprise Data Platform and collaborate with engineering teams to guide the evolution of our data systems to meet the challenges of increasing scale and complexity required in todays world. This entails recommending choices in our architectures for data storage, distribution, management, processing, serving, and consumption. This is a critical role in our journey towards becoming a data-driven company. Key Responsibilities Create a great engineering team culture with high levels of team engagement and satisfaction, successfully mentoring team members, and growing leaders in high-performing organizations Partner with business and product leaders to define data engineering roadmaps to scope and solve business problems Create designs/plans to scale, harden and extend data architectures and pipelines in environments that match Walmarts scale Run large-scale migration and evolution of data-centric systems Run operations while also redesigning / modernizing data engineering processes and technologyMinimum Qualifications: 15+ years of relevant experience designing, building, maintaining, and extending large-scale production data systems o Built large-scale batch and real-time cloud based distributed data systems to provide low latency delivery of high-quality data o Scaled and optimized performance tuning SQL and ETL pipelines in data lake and data warehouse environments; Applied modern tools such as Apache Airflow and Spark for orchestration of data pipelines o Developed expertise in operational data stores such as PostgreSQL, SQL Server, MySQL, Cassandra, and analytical data stores/query engines such as Teradata, Vertica, Snowflake, Spark-SQL, Presto o Deployed data engineering and machine learning solutions on Apache Spark, and developed understanding of the Apache Hadoop ecosystem and distributed computing o Experienced in real-time steaming distributed data processing using Apache Flink, Storm, Kafka, Spark Streaming, Google Cloud Dataflow, Azure Event Hubs, or Apache Beam o Delivered highly resilient and performant APIs for accessing data tuned to various access patterns and workloads. Deep familiarity with microservices architecture and approaches such as API gateways, service meshes, tracing, and the data architecture necessary to serve effective APIs o Championed next generation data architecture strategies in data pipeline, analysis, and storage solutions o Experienced in public cloud environments: Microsoft Azure and Google Cloud data processing environments across Azure SQL Data Warehouse and Bigquery o Championed modern engineering and devops practices across: engineering planning, code review, CI/CD/release/test automation, static code analysis, monitoring and issue resolution 10+ years of relevant experience in people leadership: recruiting, career development, mentorship, and organizational design Experience managing large teams (100+) data engineers across multiple locations (onshore and offshore experience is essential) Developed and mentored strong engineering leaders, managers, and directors Strong cross-functional leadership and relationship building ability Strong interpersonal and communication skills, including the ability to explain and discuss technical concepts and methodologies with colleagues and clients from other disciplines Effective communicator; courage to challenge with candor, motivates and inspires Strong software engineering skills and best practices including experience with a modern agile development and deployment workflow Bachelors Degree in Computer Science, Distributed Systems, Software Engineering, or related fieldCategory:Data Science / Machine Learning Brand:Walmart Labs
Posted: 2020-02-18 Expires: 2020-04-27

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Sr Director, Data Engineering

Walmart
Sunnyvale, CA 94086

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast